There's also the Quantcast File System, a C/C++ drop-in replacement for the Hadoop file system.
182 posts • joined 16 May 2007
In other words they stuck some Illumos based distribution like OpenIndiana or SmartOS on top of commodity hardware, added a Web UI, and called it a day. ZFS deduplication is a notorious memory hog and not recommended for production use. Compression works very well, on the other hand.
As for BTRFS, it is at least 5 years behind in terms of maturity and robustness, ZFS is available for Linux as well, just not shipping together because it's license is not ideologically pure enough for the ayatollahs of GPL.
Good summary, here is some extra color
My credentials: I worked for France Telecom's R&D, hold one patent on online micropayment systems and deployed a successful one in the early days of the Internet (1997 or so).
There are 2 prizes they were all contending for: the ability to skim commissions from all mobile payments, and the ability to mine customer transaction data.
The banks (well, credit card issuers) own both in the current credit system. They have historically been extremely paranoid about telcos, and successful m-payment initiatives like M-PESA in Kenya (with which Vodafone essentially disintermediated the banks and corrupt government) certainly stoked that.
Google obviously hungers for #2, #1 being mere cherry on the icing.
The handset makers had a much weaker position, as in the US at least the telcos are their biggest customers and hold the whip hand, as demonstrated by Nokia's failure to penetrate the US market to the same extent as worldwide.
Apple never entered the fray until Apple Pay, unlike some of the Android handset makers. Apple Pay essentially implements banking industry standards on the banks' terms, for a very modest commission. In other words, they cut a deal with the banks to get an acceptable #1 and forgo #2, and in the process gave the banks a way to snatch victory from the jaws of defeat at the hands of Google or the carriers.
In the West, iPhone users are the choice demographic in terms of spending power, and I expect Google will have to cave to the banks' demands and implement a form of EMV tokenization similar to Apple's. It's unclear whether they will be allowed to ingest transaction data. The carriers have already bowed to the inevitable.
If the ability to show ads was implemented in the H.264/H.265 codecs themselves, HDMI is not a panacea.
I've been looking for firewall rules to block Samsung voice control and ad servers, but can't find anything. There's got to be an opportunity in syndicating blacklist, as AdBlock does, although for IoT I think the default mode should be whitelisting with transparent parodying.
The US rape rate is at least 3x higher than India's
Please do some basic research before besmirching my ancestors' land. Paternalistic it may well be, and there have been some horrific incidents in the news, but as statisticians will tell you, what you really have to worry about are the risks that have become so commonplace they no longer make the news, like car accidents.
According to Wikipedia: "The incidence of reported rapes in India for 2010 were 1.8 per 100,000 people, among the lowest in the world. The US figure for 2010 was 27.3 per 100,000. However, it is estimated that only 1 in 10 rapes in India gets reported, while in the US 46% are reported.".
So if we extrapolate: India - 1.8 x 10 = 18 per 100,000, US = 27.3 / 0.46 = 59.3 per 100,000, or 3 times higher than India. And I am guessing this figure does not count the horrendous incidence of rape in US prisons, which is so high the majority of rape victims in the US are actually men (incarcerated), not women. For reported rapes, the ratio is 15x.
Big Data is overrated
Big is not the same as valuable. Just because you know your customers does not always mean you understand them or can manipulate them, in other words it is not always actionable. Tesco's meltdown, despite their loyalty card prowess, and the fact they are willing to ditch the alleged Big Data Crown Jewels, indicates they now agree.
CBC mode is not considered best practice any more
I suppose it could have been worse, as they could have used ECB, as a surprising number of "security" products still do.
The keypad is OS-independent, which is nice for Linux users, or Mac users tired of waiting for IronKey to update their unlocker app for the newest version of OS X.
It's nice they used a solid aluminium chassis for the drive. Boo for USB2. One of the great things about the IronKey S200 is that it uses SLC memory, which made it a very speedy drive (unlike the horrendously slow MLC IronKey D200). I wonder where the Toshiba fits, performance-wise.
I have always disabled Flash entirely on my primary locked-down browser (Chrome), but the last incident made me reach my tipping point. My plan is to remove Flash entirely from my Mac, and leave it in a VirtualBox VM ghetto for when I absolutely need it. That way I won't have to restart all my browsers each time there is a security update, and the damage from compromise is contained.
The flaw in this plan is that Chrome bundles Flash, so there would still be the taint of Flash on the main OS X.
Re: One or the other?
The Polity is not yet post-scarcity, it is just post-poverty. The Culture could be seen as the Polity after a few millennia to mature and wipe out or tame existential threats like the Jain.
France Telecom never tried to use the Orange brand in its short-lived foray in the Netherlands, a country actually ruled by the House of Orange-Nassau (confusingly, the eponymous Orange is actually the city in the South of France).
FT is phasing out its branding for Orange, which is basically the new, country-neutral name for FT both in France and worldwide.
Theory and practice
Typical academic paper making simplistic and very optimistic assumptions about failure modes. In my experience about one third to one half of storage faults are Byzantine, I.e. the drive doesn't just go down, it is actively attempting to sabotage your array by sending interfere down the bus (specially on buses where this is theoretically impossible like FC-AL) or all sorts of crippling behavior. Something like that will still require physical intervention.
Here is an excellent introduction to the subject:
And of course John Gall's immortal classics about systems thinking.
4K is now
I bought a house 6 months ago. It came with a media room with a 20 year old 42" 720p LG plasma with massive amounts of burn-in and frizzy pixels. My 85lb 46" Toshiba was heavier than the 76lb LG and I wasn't sure the wall mount was rated for the weight, so I replaced both with a 50-inch Samsung HU8550 that weighs half their weight, yet barely takes more space due to the thinner bezel.
The premium for a 4K screen is under $250 over comparable 1080p TVs, so it's a no-brainer for an appliance that is just too inconvenient to install more than once a decade because of its bulk. I went over reviews for the handful of models certified by Netflix for 4K streaming, so I do have some content available via the SmartTV, including Amazon now (no AppleTV or Roku or whatever supports HDMI 2.0 4K resolutions).
Paucity of 4K is not an issue, as I always expected the primary source would be my photo collection (4K=8MP) and 4K home video should become mainstream within a year or two as hardware H.265 compression chips find their way into smartphones. The Samsung doesn't have good photo casting options for a Mac user (surprise surprise), so I have to use a USB stick, but it works and is gorgeous.
I would say buying a 2K set today would be just as short-sighted and penny-wise-pound-foolish as buying a 720p set 5 years ago.
He is stunningly Naive
If he thinks the threat model for investigating high-level corporate malfeasance should not defend against state-level actors. All evidence shows the NSA has a sideline in economic espionage, whether from deliberate policy, horse-trading for reciprocal favors or simply personal corruption of NSA leaders is irrelevant. It is highly likely big establishment firms like BP or Unilever benefit from the same chumminess from GCHQ, and so on.
You've got to wonder how much of this is driven by the transition from tape to disk. Certainly primary storage on laptops and enterprise first-tier is going all-flash, and mobile was always thus. The HDD iPod was discontinued. Hard drives seem to be increasingly relegated to cold storage.
The primary factor is the American Medical Association's cartel deliberately restricting supply to keep prices high. The second is Big Pharma leveraging the corruption of Congress, e.g. Medicare is forbidden by law to negotiate volume discounts on pharmaceuticals. The third factor is a very high level of administrative expenses (which includes marketing costs), primarily driven by the arms race between insurance companies who systematically deny claims or "misplace" them, to the point medical practices need to hire full-time staff to deal with insurance companies. The cost of hospital procedures is incredibly variable. Another cause is gross corruption of some doctors who over prescribe tests in exchange for kickbacks.
Re: But the elephant in the room...
Half of healthcare dollars in the US are spent by the federal government (Medicare and Medicaid, to a lesser extent the VA). The system is corrupt and grossly inefficient, eating up twice the proportion of GDP as in France, for no better outcomes That in itself accounts for nearly 5% of GDP that should be removed from welfare spending to compare the value of the assistance rendered. The other big factor is how higher education is significantly more expensive in the US, but that's more a concern of the middle class, not the poor.
Joyent's Solaris-derived SmartOS shows how containers (a.k.a zones) can coexist with KVM-based VMs on the same kernel. All modern Linux distros have similar capabilities, if not quite as refined. The battle is about management tools - the company that controls the de-facto standard can make a lot of money, see how VMware gave away ESXi, the real revenue is in vCenter, and value-added features like HA and vMotion.
Both public cloud and hypervisor vendors will gain container capabilities. AWS and Microsoft have already made announcements, the others, including VMware, will follow. It seems to me new applications will be designed for, and run directly in containers, whereas heavyweight VMs will be reserved for migrated legacy workloads. Containers do require automation tools like Puppet/Chef/Ansible/Saltstack to be manageable, however, as does the Cloud. Another opportunity to sell to the enterprise.
The efficiency gains from containers are nothing to sneeze at, you can squeeze an order of magnitude or two more containers than VMs on the same hardware, not a mere 10%. For cloud providers, specially PaaS ones, this is compelling. Even for IaaS, thin provisioning is easier to achieve with containers. Linux based container solutions need to reach the levels of maturity of Solaris, specially as concerns security as the recent Docker vulnerability shows. Using a better file system like ZFS (as done by SmartOS or Flocker) is also a big boost, and can provide something close to vMotion in terms of ability to migrate workloads, if not yet online (shutdown required).
Some of the more important gains are in the realm of latency - SSDs give, and VMs take away. At my company, switching from AWS to a containerized private cloud (OpenIndiana) yielded significant improvements in cost (6x), latency (1/3), throughput (3x) and uptime (MTBF went up 30x).
I've already stated my belief VMware style hypervisors will be relegated to a niche of hosting legacy workloads. Nothing wrong with that, and it can be quite lucrative, as shown by IBM. Container vendors won't be able to extract the same profit margins, because they are built on open-source, so the legacy vendors may still end up gobbling up the new entrants. In other words, legacy workloads may represent a small fraction of future volume, but a large portion of value.
Lots of fat to cut from their budget
Mozilla suffers from a sort of Parkinson's law - make-work expands to fill all available budgets. They have many utterly useless projects like Open Badges (http://openbadges.org/) that could be axed completely with no effect whatsoever on their mission (if anything, getting rid of the distractions should improve the focus on what matters, the browser and the mobile OS).
IIRC John Lettice is the Editor of The Register, and his words carry weight.
Emil Michael mentioned specific budget and manpower, in the context of a sleazy PR event, and his previous job was at Klout, the epitome of social-media douchebaggery. This was not an off-the-cuff remark, but a trial balloon for something that has already undergone a feasibility study. His incredibly vague job title (VP of Business? Really?) suggests skulduggery is his real job description and all the flak Uber has been receiving is if anything understated.
AT&T's fiber plans are vaporware, and have been for the last 20 years, despite getting a big chunk of the $200Bn that were supposed to support fiber rollouts.
Verizon did have the good grace to invest in its infrastructure (FiOS), although it has frozen further rollouts, but AT&T/SBC's corporate culture is to milk its rotting infrastructure for profits and never invest back into it.
A rose by any other name...
It's fairly straightforward. "Software-defined storage" is a meaningless phrase coined up by storage marketing shills in an attempt to capture the halo effect that currently surrounds "Software Defined Networking" (SDN), which is still going strong in the hype cycle, with its positive associations of cost savings by commoditization.
Storage, like networking, is one of the few areas of the IT industry that has managed to preserve its fat profit margins, but distributed storage architectures like Hadoop from the Web-scale world are putting an end to that, and the high-performance storage is going direct-attached SSD anyways, as the latency of a SAN or NAS array is unacceptably orders of magnitude higher.
Re: Many good points - however
A Mamiya 7 or a Fuji 670 are comparable in weight to a premium 35mm SLR.
It's not as if WiFi ever gets remotely close to the maximum theoretical bit rate, even with 802.11ac, so saturating Gigabit Ethernet is still a distant pipe dream.
Apple could ban the CurrenC app in tit for tat, but they probably won't bother as it looks likely to be stillborn. The Wal-Mart demographic doesn't overlap Apple's too much, but CVS should definitely be concerned at losing market share to Walgreens.
US chocolate stereotypes are 20 years out of date
European expat here, been living in San Francisco for nearly 15 years. Comments about American chocolate are ignorant. Just because LA is a wasteland doesn't mean Hershey's is the only choice available. There are some world-class US-based chocolate makers like Amano (Salt Lake City) or Guittard (Bay Area) that can compete with the best Europe has to offer. The US artisanal chocolate scene is vibrant, as is the bean-to-bar movement. Remember, the US is a huge and wealthy country, and even if the average standard of chocolate is abysmal, a small fraction of connoisseurs can easily sustain quality suppliers.
US chocolate standards are stricter than Europe's, as only a product made with 100% cocoa butter can be labeled as chocolate, whereas in Europe, because of British lobbying "chocolate" can be legally adulterated with up to 5% margarine. Granted, Hershey's is lobbying to water standards down to European standards, but they haven't succeeded yet.
Re: If the ITU ran the Internet
Nope, we'd be running CLNP over X.25 over ISDN. Or more likely, nothing, since no one would have been able to afford it, assuming any vendor would have been able to implement the spec in the first place. Remember, ATM is actually the forward-looking protocol among that set. In my misspent youth when I worked for France Telecom circa 1996, their R&D Dept. was very proud to have produced an IP-free web browser that used ATM instead of TCP, Because clearly TCP/IP was the main hindrance to adoption of the web...
It's always the public key crypto used for key exchange that is the bottleneck
Re: Industry has had IoT for quite a while
Yes, and those SCADA systems are notoriously insecure despite their high prices and the fact they control critical infrastructure and are managed by professionals . Even air gapping is insufficient, cf. stuxnet. What hope does cheap semi-disposable consumer equipment run by people without a clue have?
Apple hyping this release as the biggest ever is ridiculous, as the user-visible improvements are minor. There are 2 I was eagerly awaiting, however: Duckduckgo as default search engine, and reporting which apps are battery hogs.
Re: Watch this space
Technically, it's mercantilism, not chauvinism (although the two are closely related).
Every major economy did it: the UK against the Netherlands in the 17th century, the US against Britain in the 19th (this was one of the drivers for the Civil War, the North wanted mercantilist policies, whereas the commodities-driven export economy of the South was against), Germany in the 19th as well, Japan after WWII. It's only after mercantilism has succeeded that the countries who used it successfully to wrest economic leadership suddenly turn into ardent free-marketers urging emerging powers not do do the same.
That said, China is close to the shifting point - Huawei's R&D budget and yearly patents are among the highest in its industry, for example, and they have other world-leading companies like Haier.
"Google-powered devices will be equally attractive to those who value their privacy."
Google is the #1 threat to privacy, even ahead of the NSA. No one who values their privacy uses their services. The single greatest feature in iOS 8 is DuckDuckGo as a search engine option.
Re: Apple NFC
NFC is for Apple Pay only.
Apple wants you to use Bluetooth Low Energy (BT 4.0 Smart) for all the use cases you describe. You can pair your phone with your AppleTV that way, for instance. They probably put in NFC under duress as that was the only way to interoperate with payment terminals already out there, which support NFC but not BLE.
Re: Well there you go
Their market share of attractive (i.e. spendthrift) demographics is huge, however, and that's what matters most for merchants.
Re: Help me out here...
The issue is cellcos, banks and handset manufacturers were all angling for the pie. If they couldn't succeed, they would make sure the others failed. Net result: stalemate. Verizon disabled NFC and the Secure Element in the phones they sell, for instance (they want the SE to reside in the SIM card where they can control it, not in the phone where the handset manufacturer is).
Apple clearly has cut a deal with the banks where they agreed not to take a cut or collect data, so they have a better chance of getting adoption on the merchant terminals because banks won't actively sabotage their efforts the way they did with Google, Samsung or Verizon.
On the flip side, this system is built on a foundation of quicksand, the terminally insecure credit card number. It's not clear how it will handle the 2015 transition to EMV.
Yay for 4K
I just bought a 50-inch Samsung HU8550 for $1800 (after $700 instant rebate) to replace the ancient 42-inch analog 720p plasma set that came with my new house (burn-in and crazy pixels galore). This unit is certified Netflix 4K compatible, but I fully expect the primary 4K content will be from projecting photos. A 4K TV has 8 megapixels and is ideal for that purpose. The price is about double what an equivalent 1080p unit costs today, and most likely the price will fall down to the current level within a year or two, at which point no one will buy a 1080p model, just like no one buys SD or 720p today.
The key is to buy a set with HDMI 2.0, HDCP 2.2 and HEVC/H.265, which only became available in 2014. To qualify for the UHDTV 4K label, TVs also need 10-bit color, which is not yet widespread.
Re: "If you want to listen to great-sounding music"
You can buy musician's earplugs like Etymotics to reduce sound levels without altering the frequency response.
Ghafoor has known about this for a while, and has been at the forefront of exposing warrantless surveillance, hence the retaliation. Here is his lawyer six years ago recounting the Kafkaesque process of suing the government for it:
I just tried it
It's like the Netflix of music. Exceedingly limited collection, even for music older than 6 months.
Re: So let me get this straight...
If they have 34% of the market, 34% of $30M is $10M, not $6M or $5M.
Amazon has 80% market share in eBooks in the US, and higher internationally. Apple is hardly the monopolist in books (the only industry they are one is music downloads).
What Amazon is asking publishers to do is subsidize the predatory pricing it will engage in, to kill off competitors like Barnes & Noble, and thus make the publishers even more dependent on Amazon's monopsony. Kind of how the Chinese government charges the families of executed people for the price of the bullets...
Re: bully boy, more like pushover...
"Shows how much you know, there has never been a recent trade agreement that has worked out for the US."
Whether those trade agreements work for the US as a whole is debatable, but they certainly work very well as designed for those in power. Just like how the Iraq war was an unmitigated disaster that will cost anything from $2 Trillion to $4Tn when all the costs are tallied, but helped make Dick Cheney and his cronies billions in war profiteering. The net total is highly negative for the US as a whole, but it's all upside for those who made the decision.
How is this new?
People have been using Skype and other VoIP tools for over a decade and a half from WiFi hotspots. Skype will even let you log on to Boingo and pay for the access using Skype credits.
As for KPN, yes, it is one of the worst telcos in Europe, with rotting infrastructure and a disdain for customers seldom seen West of the former Iron Curtain.
That's because those devices are based on Linux, not Darwin
And thus probably using OpenSSL as its SSL/TLS stack (the main alternatives being GnuTLS, which has security issues of its own, or PolarSSL).
One of the little secrets Apple would rather keep to itself...
Re: arm -> low power. POWER -> ?
Better single-thread performance is a valid answer. I'm sure there are algorithms even Google's PhD's haven't been able to parallelize yet, and need the fastest cores it can get. CPU power consumption is only a small part of server power utilization, and I find it hard to believe POWER can match the throughput per dollar of x64, but then again neither will x64 match server ARM64 when it starts shipping in volume in a couple of years' time.
It has to do with the economics of processor R&D and fab investment. Intel (and AMD) server processor R&D rides on the coat-tails of the much larger desktop/laptop processor market with its huge economies of scale. Niche processors like POWER have much smaller shipments to amortize the R&D on, or build a use-case for hugely expensive leading-edge fabs. There is thus a chicken-and-egg effect that prevents them from reaching the price/performance point of Intel processors.
Even Intel is feeling the pinch, as shown by Krzanich's recent moves to open Intel fabs to third-party designed chips. AMD couldn't keep up, despite having invented x64, and had to spin off its own fabs.. Even Intel and HP couldn't make Itanium succeed in the marketplace, despite access to Intel's fab prowess and HP's server market share, it's hard to see how a hollow shell of a company like IBM could achieve that. Google might, but just how strong is its commitment to the platform? Enough to fund ongoing R&D into the platform? Seems doubtful - their hardware investments this far have concentrated on cutting margins and middlemen, e.g. building their own switches from Broadcom parts.
ARM has even higher volumes than Intel, if not fat juicy margins to fund R&D from, and is thus the more likely disruptor, something Intel is keenly aware of, as ARM's strategy is essentially the same one Intel used with great success to kill off RISC architectures.
Another step in the wrong direction, stagnation and irrelevance
Mozilla is rich due to the advertising fees Google pays it for being the default search engine in Firefox. Paradoxically, this comfortable situation means they are not experiencing a sense of urgency commensurate with their slow Yahoo-like slide towards irrelevance as mobile (Webkit/Blink-based) browsing is usurping the desktop.
The search referral wealth is also funding a lot of useless claptrap like Open Badges that are a distraction from the radical changes Mozilla needs to make if it is to survive. The organization will need strong technical leadership to make this happen, and it isn't going to come from wishy-washy liberal arts or marketing types like Beard or Mitchell Baker. Losing Eich is a terrible blow, however unpalatable his opinions may have been, and replacing an engineering-background CEO with a marketer makes it less likely that a replacement will accept the job.
ICANN is mostly a failure
They failed to wrest control of the dot-com zone back from Verisign, and have mostly tacked on additional fees on domain name registrations. Indirectly that means the Department of a Commerce has failed in its oversight. The organization is opaque and unaccountable (google "Karl Auerbach ICANN). There are a few bright spots like DNSSEC and IDN, but they are few and far between.
Putin, Erdogan, Iran or the Chinese Communist Party don't need control over ICANN to enforce Net censorship. The only question is about fighting for the gravy train.
That use case makes sense, but getting more notifications is the last thing you should want. Without getting all Zen or Walden-esque about it, interruptions break your flow and hinder your ability to get things done. Frittering your attention onto what your phone or smartwatch thinks is important means you are ceding the control of your most important resource to someone else, e.g. advertising companies and their business need to turn us into Pavlovian dogs awaiting their next hit of notification so we can be exposed to more ads.
Rich nerds wear expensive Swiss mechanical watches
It's one of the few articles of jewelry a man can wear without appearing tasteless, along with cufflinks.
Most of these are automatic and don't need recharging or rewinding.