Engineering For Slow Internet Even When Not Stuck In Antarctica

September 5, 2025 by Maya Posch 25 Comments

With the days of dial-up and pitiful 2G data connections long behind most of us, it would seem tempting to stop caring about how much data an end-user is expected to suck down that big and wide broadband tube. This is a problem if your respective tube happens to be a thin straw and you’re located in a base somewhere in the Antarctic. Take it from [Paul Coldren], who was stationed at a number of Antarctic research stations as an IT specialist for a total of 14.5 months starting in August of 2022.

Prepare for hours of pain and retrying downloads. (Credit: Paul Coldren]

As [Paul] describes, the main access to the Internet at these bases is via satellite internet, which effectively are just relay stations. With over a thousand people at a station like McMurdo at certain parts of the season, internet bandwidth is a precious commodity and latency is understandably high.

This low bandwidth scenario led to highly aggravating scenarios, such as when a web app would time out on [Paul] while downloading a 20 MB JavaScript file, simply because things were going too slow. Upon timing out, it would wipe the cache, redirect to an error page and have [Paul] retry and retry to try to squeeze within the timeout window. Instead of just letting the download complete in ~15 minutes, it would take nearly half an hour this way, just so that [Paul] could send a few kB worth of text in a messaging app.

In addition to these artificial timeouts – despite continuing download progress – there’s also the issue of self-updating apps, with a downloader that does not allow you to schedule, pause, resume or do anything else that’d make downloading that massive update somewhat feasible. Another thing here is distributed downloads, such as when hundreds of people at said Antarctic station are all trying to update MacOS simultaneously. Here [Paul] ended up just – painfully and slowly – downloading the entire 12 GB MacOS ISO to distribute it across the station, but a Mac might still try to download a few GB of updates regardless.

Continue reading “Engineering For Slow Internet Even When Not Stuck In Antarctica” →

Is A Pigeon Faster Than The Internet?

September 2, 2023 by Chris Lott 46 Comments

[Jeff Geerling]’s latest project is for the birds — literally. Even though he has a brand new high-speed fiber optic internet connection, online backups of YouTube video projects still take hours. He decided to see if the conclusions from a 2009 in South Africa study still hold true today — that using carrier pigeons to send files can be faster than the internet. [Jeff] sets up an experiment to send 3 TB of data by homing pigeon a distance of one mile to establish a baseline. Next, [Jeff] sends the same 3 TB of data over the internet, and donning the cap of honorary pigeon, simultaneously embarks on a journey by air to his off-site backup service in Nova Scotia, Canada.

Never underestimate the bandwidth of a station wagon full of tapes hurtling down the highway.

[Jeff] points out that you also have to consider the transfer time of your files onto and from the pigeon-suitable memory cards. He jumped through several hoops to minimize that, but it still consumed 2-1/2 hours total. Trying to keep the comparison fair, he also spent a couple days optimizing his internet connection to eek out the best possible speed. Continue reading “Is A Pigeon Faster Than The Internet?” →

German Experiment Shows Horses Beating Local Internet Connections

September 15, 2021 by Lewin Day 61 Comments

These days, we’re blessed with wired and wireless networks that can carry huge amounts of data in the blink of an eye. However, some areas are underprovisioned with bandwidth, such as Schmallenberg-Oberkirchen in Germany. There, reporters ran a test last December to see which would be faster: the Internet, or a horse?

The long and the short of it is that Germany faces issues with disparate Internet speeds across the country. Some areas are well-served by high-speed fiber services. However, others deemed less important by the free market struggle on with ancient copper phone lines and subsequently, experience lower speeds.

Thus, the experiment kicked off from the house of photographer [Klaus-Peter Kappest], who started an Internet transfer of 4.5GB of photos over the Internet. At the same time, a DVD was handed to messengers riding on horseback to the destination 10 kilometers away. The horses won the day, making the journey in about an hour, while the transfer over [Kappest’s] copper connection was still crawling along, only 61% complete.

Obviously, it’s a test that can be gamed quite easily. The Internet connection would have easily won over a greater distance, of course. Similarly, we’ve all heard the quote from [Andrew Tanenbaum]: “Never underestimate the bandwidth of a station wagon full of tapes hurtling down the highway.”

Notably, [Kappest’s] home actually had a fiber line sitting in the basement, but bureaucracy had stymied any attempts of his to get it connected. The stunt thus also served as a great way to draw attention to his plight, and that of others in Germany suffering with similar issues in this digital age.

Top speeds for data transfer continue to rise; an Australian research team set a record last year of 44.2 terabits per second. Naturally, the hard part is getting that technology rolled out across a country. Sound off below with the problems you’ve faced getting a solid connection to your home or office.