Controlling Your Car With Gestures

Autonomous Driving

Oct 2020,

In this Proof of Concept project for a major german automotive company we built and showcased a unique user interface: gesture recognition for control over the central console. Accepting or declining calls with simple swiping gestures was achieved with an Apple watch as the device of choice for the hand motion recognition.

gesture-control

The
Challenge

The use case involved swiping your hand to receive or cancel calls with a SmartWatch as the device for gesture recognition. The information would be sent directly to the car.

The
Solution

We created a deep learning model to recognize some predefined hand gestures like swipe right/left, tap, etc. As a result, we converted that model to Apple’s own CoreML model that allowed us to run the neural network directly on the Apple Watch.

The
Impact

This project was a technical Proof of Concept showcasing a unique user interface: gesture recognition while driving.Users were able to control the entertainment system of the car with simple hand gestures.

Technologies

  • Keras
  • CoreML
  • Python
  • TensorFlow
  • WatchOS

Team Size

2 people

Year

2017

Maturity Level

Proof of Concept

Want to build a product of the future?

The
Challenge

The use case involved swiping your hand to receive or cancel calls with a SmartWatch as the device for gesture recognition. The information would be sent directly to the car.

The
Solution

We created a deep learning model to recognize some predefined hand gestures like swipe right/left, tap, etc. As a result, we converted that model to Apple’s own CoreML model that allowed us to run the neural network directly on the Apple Watch.

The
Impact

This project was a technical Proof of Concept showcasing a unique user interface: gesture recognition while driving.Users were able to control the entertainment system of the car with simple hand gestures.

Technologies

  • Keras
  • CoreML
  • Python
  • TensorFlow
  • WatchOS

Team Size

2 people

Year

2017

Maturity Level

Proof of Concept

Want to build a product of the future?

The
Challenge

The use case involved swiping your hand to receive or cancel calls with a SmartWatch as the device for gesture recognition. The information would be sent directly to the car.

The
Solution

We created a deep learning model to recognize some predefined hand gestures like swipe right/left, tap, etc. As a result, we converted that model to Apple’s own CoreML model that allowed us to run the neural network directly on the Apple Watch.

The
Impact

This project was a technical Proof of Concept showcasing a unique user interface: gesture recognition while driving.Users were able to control the entertainment system of the car with simple hand gestures.

Technologies

  • Keras
  • CoreML
  • Python
  • TensorFlow
  • WatchOS

Team Size

2 people

Year

2017

Maturity Level

Proof of Concept

Want to build a product of the future?

The
Challenge

The use case involved swiping your hand to receive or cancel calls with a SmartWatch as the device for gesture recognition. The information would be sent directly to the car.

The
Solution

We created a deep learning model to recognize some predefined hand gestures like swipe right/left, tap, etc. As a result, we converted that model to Apple’s own CoreML model that allowed us to run the neural network directly on the Apple Watch.

The
Impact

This project was a technical Proof of Concept showcasing a unique user interface: gesture recognition while driving.Users were able to control the entertainment system of the car with simple hand gestures.

Technologies

  • Keras
  • CoreML
  • Python
  • TensorFlow
  • WatchOS

Team Size

2 people

Year

2017

Maturity Level

Proof of Concept

Want to build a product of the future?

Related Insights

All Insights