Raspberry Pi – Head Mounted Display Tutorial

 

DIY Head Mounted Display Tutorial

DIY Head Mounted Display Tutorial

Head mounted displays are definitely the latest fad that’s going around town now. You might have seen several wearable displays such as the google glass, and many others including virtual reality systems like the oculus rift. Head mounted displays are primarily used for video sharing, navigation, checking notifications, etc. However, several pioneers argue that the quintessential use for it have not yet been identified. But, if you ever wanted to build one for yourself from scratch, and are not willing to pay 1500$ just to experience its functionalities, then this DIY Head Mounted Display tutorial is for you.

This DIY hacking tutorial will show you how you can make your own head mounted , virtual reality or augmented reality displays. I have built a “Smart Cap” , first of its kind , having a head mounted display on it. Here, I will instruct on how to build a monocular wearable display that runs on the raspberry pi as seen in the picture above. The system includes a webcam for video sharing and recording and also incorporates voice recognition for a hands free experience. Thus, you will be able to build an interactive voice recognition based wearable display at the end of this tutorial.

DIY Head Mounted Display Project

Aspheric Lens

What are the stuff required to do this project?

Hardware:

  1. Raspberry Pi model B.
  2. A USB webcam with an inbuilt mic, I am using one from Iball.
  3. A 2.5″ NTSC/PAL LCD display (Since this display is not available in India, you can check this alternative: Raspi LCD)
  4. A headphone with mic.
  5. A loupe magnifier with aspheric lens.
  6. Sun board sheets or cardboard sheets.
  7. Fevicol SR glue or equivalent.

Software:

  1. Rasbi OS image with Voice Recognition Software.

How does it work?

DIY Head Mounted Display tutorial DIY Hacking

2.5″ LCD display

Head mounted displays usually consists of a high resolution LCD or any other display screen within about 5-10 cm in front of your eyes. For virtual reality systems, usually one split display or two identical displays are used for each of your eyes for the stereoscopic effect. Here, I am only using one miniature LCD display in front of an eye , hence called a  monocular head mounted display.

In this system , in order to cope with the “Least distance of distinct vision” , which is about 15-25 cm , I have used an aspheric loupe magnifier lens having 5X magnification. This makes it possible for me to see the screen impeccably at about 5-6 cm from my eye. The display is also completely enclosed and insulated from outside light. The next part of the system is a normal USB webcam which was cannibalized to take only the camera and the microphone. All the plastic enclosures of it was removed, and the wires were re soldered to get a niche position for the camera and microphone on the cap. Furthermore, I used a raspberry pi running a voice recognition software I engineered, to ensure hands free operation.

DIY Head Mounted Display Project DIY Hacking

DIY Head Mounted Display tutorial

Here, the LCD display acts like any other PC display. However, when certain voice commands are executed in tandem with the system, appropriate results or data is displayed in front of your eye. A few of those examples are : email , maps for navigation, Google search, YouTube, webcam recording and first person viewing of other cameras, etc. The raspberry pi integrated with this head mounted display thus has to be connected to the internet for performing these functions.

Step 1: Preparing the head mounted display enclosure

DIY Head Mounted Display Tutorial

Cutting the sun board sheet for preparing the head mounted display enclosure

It is necessary that the display needs to be cut off from all external light sources to ensure a sublime viewing experience. Here, I have used plastic sun board sheets, the kind of sheets normally used for vinyl advertising, for making the enclosure. Cut out a piece of the sheet of length 21 cm  and width 6 cm. Mark cross sections vertically at 6 cm , 10.5 cm , 17 cm and 21 cm as shown. Next, take a cutting knife with the length of the blade adjusted to be just 3 mm. On the lines earlier marked, cut through half way of the board. This will ensure, that the board bends properly to form a rectangular enclosure for the display.

DIY Head Mounted Display Tutorial

Cutting half way through the sheet

Now, hot glue the circuit board attached to the display to its back. This will make it a rigid one piece display as shown. Next, apply fevicol SR glue or any other synthetic rubber based adhesive to the edges of the display and stick it to the sun board sheet as shown. Bend and stick all the edges of the display and finally seal it, to make the enclosure.

DIY Head Mounted Display Tutorial

Sticking the enclosure to the display

Step 2: Attaching the lens for the head mounted display

DIY Head Mounted Display Tutorial

Take outlines of your face for cutting off the enclosure’s contours

The enclosure prepared , now has to be cut off in such a way that it fits snug with the contours of your face. Make outlines of your nose, your right eyebrow, etc using excess sun board sheets. Mark the outline obtained for the contours of your right eye on the prepared enclosure. Cut out all excess material on the four sides based on the outline. The ultimate aim being that the enclosure fits snug on your face.

DIY Head Mounted Display Tutorial

Cutting the enclosure of the DIY head mounted display

Furthermore, take the aspheric lens and place it in front of the newly modified enclosure. View the display through the lens and wrap it using black insulation tape, such that only the LCD display could be viewed through it. The enclosure and the surroundings of the display shouldn’t be seen while viewed through the lens. This ensures a better visual experience for the head mounted display.

DIY Head Mounted Display Tutorial

Sticking the lens to the enclosure of the head mounted display

Stick the lens to the enclosure using the rubber adhesive as shown. Here, I have also spray painted the enclosure black, to prevent outside light from getting in.

Next, use some sponge or soft foam like material to stick on the front crevices of the plastic enclosure. This will make the head mounted display more comfortable while wearing it. Cut out the foam sections in the same shape as the four contours of the enclosure .Stick it to the edges using the rubber adhesive.

DIY Head Mounted Display Tutorial

Covering the contours of the DIY head mounted display using foam

Step 3: Hacking the USB webcam

Take the USB webcam you have and remove its plastic enclosures. Remove the peripheral buttons, etc attached to it. Cut off the microphone attached to the circuit board. Next, salvage and remove a flexible mic enclosure with the mic from an old headphone. Now solder the new microphone terminals to the existing mic pads on the webcam circuit. Ensure, that the interconnecting wires for the mic have adequate length to be positioned near your ear. You can also use infra red leds with your webcam , so that your head mounted display will even have night vision ;).

DIY Head Mounted Display Tutorial

Hacking open a USB webcam

Now, take the webcam circuit having the camera and stick it in front of your head mounted display. This can be done by preparing a bridge using the sun board pieces. Stick the webcam circuit onto this bridge. I have used hot glue for sticking it.

DIY Head Mounted Display Tutorial

The finished DIY Head Mounted Display enclosure

Step 4: Putting it all together to make the “Smart cap” head mounted display

I had a hip hop cap lying around in my home, so I used it to attach my head mounted display. Using the rubber adhesive, I stuck the enclosure of the display on to the visor of the cap, after adequately positioning it for my right eye. The display is then powered using the 5V and GND pins on the raspberry pi. The composite video output of the pi is connected to the display via RCA connectors.

DIY Head Mounted Display Tutorial

Smart Cap – DIY Head Mounted Display

Next, I attached the microphone to the left side of the cap ensuring it to be ergonomic, again using the rubber glue. To attach the raspberry pi board on to the cap, I used velcro. I sewed some velcro strips on to the right side of the cap and used it to wrap the raspberry pi.

DIY Head Mounted Display Tutorial

Cap with the Head Mounted Display and Mic

Now you have successfully prepared the hardware for the Smart Cap head mounted display. Try it on after connecting the raspberry pi to the display and ensure its comfortable.

DIY Head Mounted Display Tutorial

Attaching the raspberry pi using velcro to the cap

Step 5: Setting up the voice recognition software for your DIY head mounted display

DIY Head Mounted Display Tutorial

Different screenshots from the head mounted display

I have prepared an interactive voice response system that responds to certain voice commands and gives you appropriate results. In order to incorporate this system , you can either use the image file for my operating system and prepare an SD card. This is the easier method, as most of the complicated stuff are taken care off, you can start using the system as soon as you plug it in the pi. First ,unzip the downloaded file to extract the .img file. For instructions on how to install this image file onto your SD card , look at step 2 of this tutorial. To begin using the voice commands , just enter the command given below and start using the system like in the video at the bottom of this post :

voicecommand -c

Or, if you would like to build and customize your own voice recognition system, please go through the DIY hacking tutorial : Voice Recognition for Raspberry Pi . In this method, you have to make sure, that you change the screen resolution for the display. This is done by editing the file /boot/config.txt , edit it using the command

sudo nano /boot/config.txt

Uncomment the line saying: disable_overscan=1 , by removing “#” , also set the framebuffer_width=320 and framebuffer_height=240 and remove the “#” from both these lines. This will create a better visual appearance for the LCD display.

The video showing the Smart Cap – DIY Head Mounted Display in action:

 

Recommended Posts
Showing 154 comments
  • toasted tech
    Reply

    Hi arvind so I’m still waiting on my screen so whilst I wait I think I might clear some things up.

    1. What is the cable used to connect the TFT display

    2.Could you provide a jasper tutorial or show me where a good video tutorial is

    3.how well does the display show as I. Is it vision blocking overlay like… How does it look when you see with it on.

    4. Is it fine to watch videos with both eyes open or should you have your left closed?because I imagine that would cause eye strain

    5.is their a way to make jasper turn on when you say a word and also not make it beep.

    Thank you for tour time and I will post pictures when I am done

    P.S my last comments got deleted was this an accident or where they considered spam because you replied to one of the 2 comments

  • Abhay
    Reply

    Where is your house?

  • Manjeep
    Reply

    Hello Sir
    I downloaded the smart cap image and burnt it to a sd card and booted it. The screen is coming inverted and how can I change it. Using voice command -c, it is not recognizing. What is the keyword?

    • Arvind Sanjeev
      Reply

      Edit the file: sudo nano /boot/config.txt . Comment the line (#): display_rotate=2

pingbacks / trackbacks

Leave a Comment

Protected with IP Blacklist CloudIP Blacklist Cloud

Start typing and press Enter to search