You are missing out big time.
Japan is very easy, safe and lots of fun.
For first timers, recommend a tour or otherwise just book a package.
Take the plunge and go for a short stay to see if you like it.
Food is amazing especially the pizza's which are the best in the world