Monday 11 March 2013

Netflix - bandwidth piglet

Netflix is notorious (at least amongst ISPs) as a bandwidth hog, consuming 1/3 of all North American internet backbone bandwidth. However, what's fascinating is that when you look at their usage from the perspective of an individual user's bandwidth, rather than the network as a whole, it's actually not overwhelming.

Some ISPs have an incentive to degrade Netflix traffic, since they have their own TV offerings they'd rather consumers bought instead. As a way to stop this happening, Netflix reports the performance it measures on different ISPs This data tells us an number of fascinating things.

1. Low bandwidth per stream
The bandwidth used per stream is low. In developed markets, the average stream is generally in the range or 2-2.5 Mbps. This isn't too much of a surprise, given that this is about typical for an SD TV picture. Whatever might fill up 100 Mbps bandwidth, it isn't likely to be standard TV

2. Performance driven by factors other than access speed
Most ISPs experienced a performance drop of approximately 5% in December (see Finland for example). Clearly this isn't because the access networks were downgraded. Rather it's likely because things got busy for the network (and Netflix) in that period, leading to congestion. This is important because it underlines that a poor experience for an end-user is often not caused by a problem in their internet access. There are many other parts of the system that can get congested

3. Access technology has relatively limited impact
While the numbers show a discernible difference between technologies, it isn't huge. In the US Verizon's FTTH-based FiOS service delivers Netflix streams at 2.10 Mbps. AT&T's U-Verse, based on FTTN, runs at 1.91 Mbps, not far behind. (Even the fabled Google fibre is only running at 3.35 Mbps for Netflix). Clearly the FTTH networks are capable of greater speed, and Netflix adapts to the available bandwidth, but in practice FiOS and U-Verse customers were having very similar experiences. This could be because there was a choke point somewhere else in the system, or the user had capped speeds (to husband data allowances) or the content was already playing at maximum resolution. No matter, the extra bandwidth was giving very limited benefit, even with a bandwidth intensive service like Netflix.

4. DSL compares well
Fourthly, the FiOS speed is all the more striking when compared to UK DSL providers. Of these only one (Everything Everywhere) was materially below FiOS' 2.10 Mbps. Of the other three, one exceeded it and two matched it (if we give the benefit of the doubt to Talk Talk, a whisker behind at 2.04 Mbps).

5 Stream speeds low relative to access network capabilities
These levels of usage (in the houses that actually use Netflix) are relatively low compared to the capability of the access network. Akamai measures average peak connection speeds at 29.6 Mbps for the US and 28.1 Mbps for the UK. While this isn't a strict apples-to-apples comparison to the Netflix figures, which are averages and will peak higher, it does suggest there's ample headroom even in today's networks.


Maybe massively higher resolution video and 3D TV will change this picture, and suddenly Netflix will be using much more? Perhaps. But even 3D TV will only require 12 Mbps, and this won't be widely used for a long time to come, not least because there just isn't that much 3D content yet.

Netflix may be a hog when it comes to the internet backbone. However, as we've seen, when it comes to the access network it's just a piglet.

EDIT:

The above post is as originally written, but MikeyB has pointed out something important I'd missed:

The Akamai average peak speeds are not averaged across lines, but but across IP addresses. Because IP addresses are dynamically allocated, one IP address might be applied to several lines in the course of a quarter (Akamai's measurement period), and Akamai's average-peak measure will only count the fastest of these lines. I'm not sure of the magnitude of this issue - it will depend on how frequently IP addresses are reallocated (particularly for fast lines), but there's no question that it means that Akamai's figures are a less good guide to the capacity of the average line than I thought, overstating it to some extent.

The other figure Akamai publishes is the average connection speed, which is undistorted by the 'peak' issues described above. However, it has its own issues. The average will be lowered by congestion at peering points, contention in the backhaul, server overload, interference with the end-user's wifi signal and various other things - none of these have anything to do with the speed of the access network, and thus this metric understates the capacity of the typical last mile connection.

Akamai's average speed will also be affected by simultaneous use in the home - if more than one person is sharing the connection, then the bandwidth 'perceived' by Akamai will also be reduced. Again, this will cause it to understate the speed of the access network, though may accurately reflect the speed available to a given person on a household.

Thus the capacity of the access network is likely lower than the peak speeds 29.6 and 28.1 Mbps for the US and UK respectively, and higher the average measured by Akamai, which is 7.2 and 6.3 Mbps.

Thus, I think the wider point that Netflix's bandwidth needs (at roughly 2 Mbps) are a long way below the capacity of the access network for the typical user stands. But my thanks to MikeyB for pointing out my error.

Tuesday 5 March 2013

Fibre lobbyists think you're stupid

I've become acclimatised to some fairly blatant distortions of data and leaps of logic by some fibre lobbyists, but every now and then I'm still taken aback. Yes, I acknowledge it happens on both sides, but I would expect better of a company like Cisco.

I've been reading Cisco's 2012 report Get Up to Speed -How Developed Countries Can Benefit from Deploying Ultrafast Broadband Infrastructures, and came across this gem. The report offers examples of ultrafast broadband services in use today, including (p11):
"French company Erdenet supplies web-based courses that students can study at their own pace using interactive video and online collaboration tools. With an ordinary DSL connection, it is difficult to add rich media such as video, audio, and maps. Such applications require fiber connections."
Video, audio and maps require fiber?  Really?

For video, YouTube specify a minimum bandwidth of 500 Kbps. Of course higher speeds will give you better video resolution, but there's a big gap between 500 Kbps and the bandwidth of even a below average DSL connection. In the UK, less than 2% of ADSL households (roughly) are getting less than 7 Mbps in the evening busy hour (when speeds might be expected to be at their worst).

For audio, the picture is even starker. Even high quality audio streams typically use 320 Kbps or less.

The idea that maps require fibre I won't even dignify with a link. We've had maps online since the days of dial-up.

What's striking about Cisco's claim is that, while I've provided some technical data above, it's absolutely not necessary to know the claim is nonsense. Any DSL user reading that report will be well aware they're able to  use video, audio and maps.

I know Cisco aren't stupid - they can't possibly believe what they wrote. So it seems like the only other option is that they think we are.

Friday 1 March 2013

'Compelling applications' for fibre - are we there yet?

Every year at about this time, the FTTH Council of Europe have their conference. They are the most enthusiastic proponents of fibre-to-the-home - they're the folks who claimed that it would be useful for remote surgery (see 0:50 of this). That's fibre to the home we're talking about ...

Anyway each year they present various assessments of the state of the European market. Part of the purpose of this (and it's a skilful bit of lobbying) is to create a sense of competition to see which country can rank highest in FTTH roll-out. The presentations have all sorts of rankings by different metrics, so almost every country can get some kind of recognition. It's like a school fĂȘte where almost every kid gets a prize. (The UK and Germany are the sulky kids who sit in the corner and won't even participate in the egg-and-spoon race).

The presentations also talk about some of the challenges that FTTH faces. Here's some disarmingly honest quotes from the Council (or their consultants) about FTTH from the last three years:

  2011: "No really compelling application that requires a fiber connection"
  2012: "No really compelling application that requires a fiber connection"
  2013: "No really compelling application yet"

Are you spotting the pattern here?

Now sometimes we're told this is a chicken-and-egg problem, that of course there aren't applications that need FTTH, because there isn't critical mass of FTTH to sustain them yet. However, according to the FTTH Council there are 107m FTTH connections around the world. Give or take, that's roughly the same as the number of basic broadband connections there were in 2003 (103m, according to the ITU).

By 2003 we had the iTunes store, Skype, streaming video, movie downloads, numerous IPTV services and many other broadband-dependent services that are critical features of the market to this day.

If 100m broadband households were more than enough to support the development of a plethora of compelling applications for basic broadband, why is it that 100m FTTH housholds don't seem to have driven any compelling applications at all?

Not only are we not there yet, it may just be the case that there's no 'there' there.