Durable passport books that can easily fit in a pocket are a relatively recent invention. Prior to the 20th century, travel papers were just that: letters or single-page documents from a monarch or…

The article has some interesting information about European passports, too.

The rise of tourism in North America and Europe in the mid- to late 19th century caused difficulties for the existing passport and visa systems in Europe and in 1861, France abolished passports and visas, with the rest of Europe following suit.

By the outbreak of World War I in 1914, passport requirements were nonexistent nearly everywhere in Europe and the United States. The First World War brought new concerns for international security, prompting the requirement of passports and visas to travel abroad.
…
the U.S. passport requirement was only a war measure that officially ended when President Wilson left office in 1921. The U.S. was not a member of League of Nations – despite it being the brainchild of its aforementioned president – and did not require passports for international travel again until Nov. 29, 1941, mere days before the bombing of Pearl Harbor.