Your DIY brain doesn't work quite right? Maybe you have a wiring problem. For troubleshooting help, check out this image, which shows that the brain is a lot more complicated than anatomical diagrams with neat labels.
In this image--created through high-angular resolution diffusion imaging (HARDI)--the front of the brain is on the right. Bundles of fibers appear as long cables. Connections between the eyes (toward the right edge of the slice) and the visual cortex at the back (left edge) of the brain show up prominently in green.
Paul Thompson of the University of California at Los Angeles, whose group created this image, expects that imaging techniques like this will be useful for discovering abnormal connectivity associated with neurological disorders.
In the meantime, you can use his picture as a circuit diagram for debugging your new brain. Good luck; you'll need it.