Development

Summer of Code 2007 - Ubuntu projects

May 30, 2007

This article was contributed by Nathan Sanders

May 28th marked the official commencement of student projects for the Google Summer of Code (GSoC) 2007. The Ubuntu Linux distribution is among the program's heavyweights, with twenty projects lined up for 2007. Its status as a significant organization is not surprising given the remarkable momentum of the distribution, which has undeniably become a juggernaut in the Free software community after only a few short years of development. The GSoC students and the Ubuntu developer-mentors they are paired with need only work for one season, but their contributions will have lasting value to the Ubuntu distribution, the applications it packages, and, in some cases, other distributions that share the code they write.

Ubuntu's GSoC projects are too numerous to explore comprehensively here. More information on all of them is available at the Ubuntu GSoC page. We contacted students and mentors from five of Ubuntu's GSoC projects and asked them to describe how their initial proposals have evolved to the projects they are now working on, what their work will do for Ubuntu users, and how other distributions may benefit.

Lois Desplat's "Revision Controlled Home Directories" (mentored by Martin Pitt)

Mentor Martin Pitt, a member of the exclusive Ubuntu Core Development Team, describes Desplat's project, dubbed "Mnemosyne," as "a backup system with extra features". Despite any temptations to go wild with the concept of revision control as is applied to code, Pitt is seeking to temper the project for the desktop and guarantee that it is minimally taxing on resources, well integrated, and extensible so that it may work with multiple backend and frontends. The results of the discussion between Pitt and Desplat was compiled into an adjusted Mnemosyne project plan and timeline.

The new plans are a bit more fleshed-out than what is listed on the GSoC project page. Canonical's own Bazaar revision control system will be adopted as the primary backend over SVN. SVN will still be implemented as an optional plugin as a demonstration of backend development. Commits of changed files could be done instantaneously, but to use resources realistically they will probably be done nightly or at some other time interval - as in a traditional backup scheme.

Revision control systems do have advantages over traditional backup schemes and the ubiquitous Recycling Bin system. The system will allow users to revert back to several versions of their files rather than one specific backup. Moreover, the system will facilitate other features typical of code repositories, even if their use for file handling isn't immediately obvious. Users will be able to merge text files, patch binaries, and keep the repository on a remote device. If the entire /home directory is revision controlled, as is planned, this will include both personal documents and configuration files. Mnemosyne will also be designed for easy extension to /etc or elsewhere.

Mnemosyne is being designed as a daemon for committing, a command-line program for configuration and management, frontends for Gnome/KDE, and heavy integration into GNOME's Nautilus file manager (with KDE's Konqueror as a goal). The file manager integration will allow users to selectively omit files from revisioning (so, for instance, a very large file is not revisioned nightly), force commits, or retrieve past versions. These tools will be written in Python, reverting to C++ if necessary to "interface with another application." The tools should all be distribution-agnostic and could very well appear outside of Ubuntu.

Desplat is a software engineering student at San Jose State University. He has experience participating in open source projects with the OGRE rendering engine. He has established a Launchpad site for Mnemosyne where users may keep track of his work. Weekly reports will also be published on the GSoC coordination list. Expect a testable version of the daemon by mid-June and beta .deb packages by early July.

Kévin Dunglas' "Privacy tool(s) for Ubuntu" (mentored by Jani Monoses)

Modeled in the style of Apple's FileVault, Dunglas is building Privacy Tool, a GUI to accomplish three principal privacy goals that he has identified for Ubuntu. His tool will facilitate /home directory encryption, swap partition encryption, and the creation of a "safe deposit box" to secure individual files. He notes that he will also build a temporary file cleanser for Firefox if time allows.

Dunglas has yet to identify the encryption backend he will use for his tool. TrueCrypt and cryptsetup have been named as possibilities. He plans to perform /home directory encryption in-place, via a backend that either encrypts in-place directly or by moving files into the new, encrypted directory. Dunglas has no plans to implement full-filesystem encryption with Privacy Tool, stating that the /home directory and swap are the most critical places for privatizing user data. The safe deposit box will be offered as a mechanism for encrypting additional files.

Privacy Tool will be a Gtk/Gnome application built with Glade and Python. Though Dunglas has no plans to port it beyond Ubuntu, he is conscious of possible ports to other distributions and is building Privacy Tool from widely available packages. He hopes to make an alpha release available towards the end of July.

Dunglas is a computer science student at the Institut Universitaire de Technologie de Lens in France. He has been involved with Ubuntu France for several years. Mentor Jani Monoses is a Romanian computer science engineer strongly involved with the Xubuntu derivative.

Krzysztof Lichota's "Automatic boot and application start file prefetching" (mentored by Tollef Fog Heen)

This project is the continuation of a longstanding effort among Linux distributions to shorten application startup time by techniques such as prefetching. According to Lichota, Windows XP implements a system whereby application and system startup are analyzed to identify files used in the process. Those files can then be "prefetched" into cached memory upon future startups to minimize overall disk access. This technique, in addition to reorganizing these files into sequential, easy-to-access order on the disc may dramatically decrease launch time.

Lichota has made the full text of his Prefetching project application available. In it, he gives detailed analysis of the various prefetching schemes which have already been implemented (including two former GSoC projects) and systematically lists their deficiencies. In short, Lichota hopes that his system will be less RAM-dependent than the Ubuntu Boot Readahead, will be more effective at analyzing application-launch file usage than Preload, and will require less user-interaction and improve on the disk defragmentation capabilities of Pagecache tools.

The key to Lichota's project will be to work at a lower level than previous systems. While the Preload method employs a daemon to periodically invoke prefetching routines, Lichota will hook prefetching into the fundamental Linux exec() function, probably by patching the kernel itself. He hopes to reuse code from these previous projects for prefetching functions where appropriate.

Lichota has already begun writing his tool for reorganizing pre-fetching files on the hard disk. Unfortunately, there are no plans to implement this tool for anything but ext3 filesystems. Lichota believes that his code will apply mostly to the kernel and that it would be fairly easy for other distributions to adopt his work. He hopes to have a working, though untested, version of the prefetching tool in mid-July and an untested version of the disk tool in August. Lichota will also implement an ext3 tool for metadata pre-caching if time permits.

Krzysztof Lichota is a PhD student at Warsaw University who has already earned a Masters degree from their computer science department. He has five years of experience working for the storage industry on cluster solutions. Lichota has been encouraging his own students to participate in the GSoC for two years now and is among several University of Warsaw computer science students who are participating in the 2007 GSoC . Mentor Tollef Fog Heen is a member of the Ubuntu Core Development Team.

Two important resources exist for those interested in Lichota's project. He has constructed a site to track progress on the Prefetching GSoC project and a general site which he would like to become a base for all future Linux prefetching development. Those interested in participating in development are encouraged to join the prefetch-devel mailinglist.

Petter Remen's "Device & Driver Manager for Ubuntu" (mentored by Kyle McMartin)

The inspiration for Remen's project comes from a device manager specification developed by Ubuntu kernel developer Ben Collins. His goal was to implement a GUI Hardware Abstraction Layer (HAL) device manager for GNOME that will allow users to modify driver configuration without touching plaintext configuration files or a command line. Collins warns that the existing GNOME hal-device-manager, which displays a hardware device tree taken from HAL, but does little for user-friendly configuration, will have to be forked and some kernel hacking may be necessary.

Remen clearly outlines his vision for the project's GUI. The tool will immediately present users with a list of hardware categorized by simple terminology, which can also be filtered by user defined criteria. For each listed device, the tool will display the currently enabled driver and allow the user to replace or reconfigure the driver. Furthermore, the tool will facilitate loading drivers from CDs or other user-specified locations and allow users to disable devices. Users will be able to save their configurations in "hardware profiles" to apply upon reboot or implement on another computer.

Remen indicates on his GSoC project page that extensibility will be an objective of his work. He lists X server and CUPS configuration, independent from HAL, as possible future extensions to his project. Although the existing hal-device-manager is cross-platform, Remen will be implementing features that will make his tool Linux-specific. If, indeed, kernel development is necessary for his project, it may be difficult for other distributions to incorporate his work.

Mentoring the project will be Kyle McMartin, employed by Canonical as an Ubuntu kernel hacker and a member of the core development team.

Tomé Vardasca's "Ubuntu bootloader manager" (mentored by Scott James Remnant)

Bootloader configuration functionality has been present in the administration tools of SUSE and Mandriva for several years, but is an element of GUI system configuration conspicuously absent in Ubuntu. Vardasca's project will integrate bootloader configuration into Ubuntu's Ubiquity operating system installer, and duplicate the functionality for a GNOME control center module. The tool is only being designed with the GNU GRUB bootloader in mind.

As outlined in the full Ubuntu bootloader manger specification, users will be able to edit the list of operating systems presented by the bootloader and their ordering, configure kernel options, set passwords for the console and operating systems, and theme the bootloader. The tool will keep a copy of the configuration in an XML file in case replacement is necessary, along with a backup to use in case of user input error.

Theming options will play a major role in Vardasca's tool. It will include an interface for installing GfxBoot, and an enhanced version of GRUB designed for aesthetics. Alternatively, the tool will enable theming vanilla GRUB with a splash screen and a custom color scheme. A theme editor will be provided for this purpose. The configuration tool will include a preview window with a screenshot of the theme.

Although the code integrated into the Ubiquity installer may be difficult to port, the GNOME control center module will be written in Python and may find its way into other distributions. Vardasca intends to provide an alpha version of the configuration tool at the end of May and complete the integration into Ubiquity and the GNOME control center by the end of July. Those interested in participating should visit the Ubuntu Bootloader Manager Launchpad project page.

Vardasca is a health informatics student at the Superior School of Technology and Management at the Leiria Polytechnic Institute. He became interested in Ubuntu after switching from Windows upon the release of Vista. He says that friends' requests prompted him to develop a bootloader manager: "I guessed I could do it in the Google Summer of Code and, surprisingly, I guessed well." Mentor Scott James Remnant is a member of the Ubuntu Core Development Team.

Comments (2 posted)

System Applications

Interoperability

Samba 3.0.25a available for download

Version 3.0.25a of Samba has been announced. "This is the second production release of the Samba 3.0.25 code base and is the version that servers should be run for for all current bug fixes."

Full Story (comments: none)

Networking Tools

conntrack-tools 0.9.3 released

Version 0.9.3 of conntrack-tools has been announced. "The netfilter project proudly presents conntrack-tools-0.9.3 The userspace daemon conntrackd covers the specific aspects of stateful Linux firewalls to enable high availability solutions, and can be used as statistics collector of the firewall use as well. The daemon is highly configurable and easily extensible."

Full Story (comments: none)

Package Management

rpm5.org launched

A new site has been launched at rpm5.org; it claims to be "the home of the official RPM Package Manager (RPM) code base". This site should not be confused with rpm.org, which is the home of Red Hat's fork of RPM; rpm5 is the Jeff Johnson fork. A RPM5 roadmap has also been posted: "The main RPM development is already focused on the development of the forthcoming RPM 5.0. The primary goals of RPM 5.0 are the additional support for the XML based archiving format XAR, an integrated package dependency resolver, further improved portability and extended cross-platform support."

Comments (13 posted)

Printing

oopstops 1.0 released

Version 1.0 of oopstops has been announced. "This CUPS filter sanitizes the PostScript jobs created by OpenOffice 2.x. It makes the PostScript jobs DSC compliant, thus further processing by the pstops filter works without problems."

Development

System Applications

Interoperability

Networking Tools

Package Management

Printing

Desktop Applications

Animation Software

Audio Applications

Business Applications

Data Visualization

Desktop Environments

Desktop Publishing

Electronics

Financial Applications

Graphics

Interoperability

Office Applications

Office Suites

RSS Software

Miscellaneous

Languages and Tools

Haskell

Python

Ruby

Tcl/Tk

Cross Compilers

Libraries

Miscellaneous