TOKYO—While Japan has 100 million Internet users—third most on the planet—and some of the most sophisticated mobile devices on the market, it can still be hard to find a wireless hotspot here.