Snap taken at my local bank during lunch. Despite having the technology to give abilities to school girls to fly and to make huge mean mecha's, Japan is still very much a cash oriented society.
While you can pretty much pay for anything with just a credit card in the US, you will find it difficult getting around on just a card in Japan.
There are many reasons why credit cards are not as popular - a few examples are:-