Campus - 17.12.2024 - 10:00
HSG students throw themselves into prototyping
A fan that turns on when someone steps in front of it, an acceleration sensor and gyroscope on the body that can be used to operate PowerPoint presentations, or an automatic watering system for potted plants: HSG computer science students have programmed and built such applications in a new course. “At first glance, these prototypes do not appear spectacular, but they were developed from scratch in just six days, and I am proud of what our students have learned and implemented in such a short time,” says HSG researcher Dr Florian Mathis.
He is part of the HSG research group Human-Computer-Interaction (HCI) and focuses on assistive technologies for blind and visually impaired people. For example, Mathis has developed a wearable camera that blind and visually impaired people can use in their daily lives and to which they can ask questions. Through targeted questions, the camera can then audibly reproduce information using artificial intelligence. For example, a blind or visually impaired person can distinguish between several objects or ask whether a product in the supermarket is currently on offer.
Prototyping is a central skill
“Prototypes are essential for finding solutions that use technology at the interface between people and computers,” says Mathis. This was one of the reasons for the new course titled “Hands-on HCI: Developing Software and Hardware Prototypes” for HSG computer science students.
The course, which took place for the first time in the autumn semester of 2024, focuses heavily on practical work and trial and error: after a day of theoretical input, the students were divided into groups and tasked with programming and building an application. “The only requirement was to create something that people could use in their everyday lives or at work,” says Mathis.
HSG researcher Florian Mathis in the makerspace of the School of Computer Science.
Project 1: Presentation tool that moves slides or zooms in on them using hand gestures.
Project 2: Fan that automatically switches on when it detects a person and also tracks their movements.
Project 3: Bird table that automatically dispenses feed and reports empty feeders.
Project 4: An irrigation system that automatically supplies water when the soil is too dry.
Project 5: Safe with individual codes for different users and a theft sensor with alarm.
Night shifts: working in the HSG Makerspace
Prototyping involves using simple means to quickly create a functioning model of a proposed solution. This prototype then receives continuous feedback from users and can thus be optimised. After two days of the course, the students presented their work to each other and discussed challenges and next steps.
HSG students were able to access the Makerspace of the HCI research group at the School of Computer Science (HSG-SCS) for the programming and construction of the prototypes: a 3D printer and a laser cutter, among other things, are available in this room. For the course, the students were also provided with a set of easy-to-use sensors, processors and cameras.
On the last day of the course, the students presented their applications to each other. They also highlighted and discussed the development process, their group dynamics and the challenges they faced.
A brief overview of the prototypes:
- Automatic watering system: This measures the moisture in the soil and waters the plant independently when needed.
- Birdhouse: This automatically dispenses food when birds approach. It also indicates when the food container is empty.
- Safe: Any number of people can open the safe with a personalised pin. This makes it visible to all users who opened the safe and when. A warning signal also sounds in the event of theft attempts.
- Fan: This is activated when a person appears in front of the fan. When the person moves, the airflow follows them by turning the fan.
- Presentation operator: An acceleration sensor and gyroscope worn on the hand enable the operation of PowerPoint presentations. For example, the user can switch back and forth between slides or highlight something using hand movements.
Some groups reported long nights and many lightbulb moments when it came to programming and construction. They learned new programming languages, soldered components, operated the 3D printer and had to create a project plan.
“The students also gain insights from the course that will help them in their professional lives. The course is very practice-oriented and thus complements the theory in the computer science degree programme,” says Mathis. The ability to quickly implement an idea in a prototype, for example, is important for start-ups: A prototype can be a good way of illustrating an idea and thus help in the search for investors.