My brothers and I once considered relocating to Costa Rica. It's a beautiful place, with nice people and it's largely unspoiled. There's a big American expatriate community there, but that doesn't mean you have to live with everybody else.
I'm not a big fisherman, but they have many miles of unspoiled, undeveloped coast line and I wouldn't mind going out and sitting by the water in the evening.
A modest home near the water is not expensive. You can buy something like this place for less than the price of a mid level new car. If you want a villa with tile floors right on the beach, most people could afford that too. The cost of living in Costa Rica is amazingly low , and you can transfer funds from North America to Costa Rica without difficulty.
The beaches in Costa Rica are better than those in North America. No greasy, sun tan lotion covered tourists, playing loud music and generally being obnoxious.
The pace of life there is slow. Taxes are minimal. Nobody cares what you do as long as you don't bother anyone else.
The local people are friendly. They like North Americans because most of them make a living from the expats, one way or the other.
I dug out the file from my home office that I kept when we were researching the move down there. Talked to the wife on the phone, she is ok with living in Costa Rica, as long as we wait til she can retire (4 more years), but we could go ahead and buy something down there and I could spend part of the year there "getting settled" so the move down would be easier later on. Talked to my younger brother, he can't go down til his son hits college age, about 6 years away. But he's up for the move.