* Posts by Charlie Clark

12172 publicly visible posts • joined 16 Apr 2007

What a Hancock-up: Excel spreadsheet blunder blamed after England under-reports 16,000 COVID-19 cases

Charlie Clark Silver badge

With the right connections you can't help but keep falling upwards: look at the current PM.

Charlie Clark Silver badge
FAIL

Re: CSV?

English is schemaless

And what do you think grammar is?

Charlie Clark Silver badge

Re: CSV?

I keep coming across CSV files that I can open with csv.reader but can't process properly because they're borked.

Charlie Clark Silver badge

Re: Sqlite3 for the win

SQLite is indeed useful but for data exchange you might also want to look at HDF, Parquet…

Charlie Clark Silver badge

Re: CSV?

somebody throws a file over the wall to you

Happens to me all the time and with variable encoding: utf-8 encoded as latin-1 is not uncommon.

Charlie Clark Silver badge

Re: CSV?

CSV is schemaless and doesn't supoort typing or integrity checks.

Charlie Clark Silver badge

Re: CSV?

That's because the C stands for "character". Can't use commas to separate fields if they're also used for decimals.

CSV was hobbled from the the get-go by not using ASCII-31 for separating fields and also by not worrying about encoding.

Charlie Clark Silver badge

Re: 'spreadsheet software as "human middleware" in the sector'

Excel isn't too bad* as a report format because it is so ubiquituous and doesn't suffer from some of the many problems associated with CSV, which is okay an an intermediate format. It's also better in many situations than PDF. But using it for data processing is asking for trouble.

* As someone who maintains a library for processing XLSX files I would say that, wouldn't I? ;-)

Institute of Directors survey says most bosses expect no mass return to the office if COVID-19 crisis ever ends

Charlie Clark Silver badge

Re: No, absolutely not!

Indeed, added to the fact that businesses can already offset investments against tax, there is no need for additional incentives. I'm also not convinced whether small businesses would really benefit at all from "more digital". Assuming they really are small, they probably already have efficient and flexible communication.

Chap beats rap in WhatsApp zap flap: Russian banker walks from insider trading case after deleting software

Charlie Clark Silver badge

Re: How did they know he had it installed?

You'd need a court order to get that information from Apple but they obviously hadn't applied for one.

Charlie Clark Silver badge

Re: Was the phone private or company?

But you'd be perfectly within your rights to delete anything the phone before an order is granted.

Charlie Clark Silver badge

Was the phone private or company?

If it was a private phone then the data would be covered by privacy regulations and I think he could not be forced to provide access: just because the app could be used for criminal purposes doesn't mean that it isn't protected by privacy statutes.

Microsoft lends Windows on Arm a hand with emulation layer to finally run 64-bit x86 apps at last

Charlie Clark Silver badge

Re: Welcome to Windows Phone all over again....

I tihnk they deliberately didn't do this because they liked selling the same thing multiple times: want Windows for x86 and x86_64? Then you'll need two to buy to different versions. This was easy enough to do with the captive market they had.

Charlie Clark Silver badge
FAIL

Re: MS is between a rock and a hard place with desktop windows

So, Android and IOS are not doing well?

Charlie Clark Silver badge

Re: MS is between a rock and a hard place with desktop windows

Windows 10 has virtually nothing to do with the Windows on DOS you're talking about. Windows NT has a completely different kernel and most of the APIs have been replaced.

The work on DotNet core shows that MS can handle multiple architectures, but it does need to improve the way Windows works in this respect. Historically, Windows was very platform-specific though this was more to do with market segregation than any real technical constraints.

The emulation is largely a signal to the market that switching to Windows on ARM tablets will be an option for their field workers because all their "important" software will still work. They'll be exceptions but basically if something with run on Windows 10, it will probably run fine in the x86 emulators on Windows for ARM.

Charlie Clark Silver badge

Re: How many years have Microsoft had to get this right?

They haven't got the best of form in this respect.

Charlie Clark Silver badge

Re: It's just fear of missing out

MS Office already runs on the two most common ARM platforms: Android and IOS.

Charlie Clark Silver badge

Re: Welcome to Windows Phone all over again....

It will have more mainstream modern applications available than Windows offers today in the Microsoft Store even counting x86.

By providing an emulator Microsoft is doing pretty much the same as Apple. CPUs are now good enough to handle the thunking in real time with users rarely noticing it (except for computational intensive resources).

And Apple isn't moving wholesale to ARM either. We've yet to see which devices will be released but it's reasonable to assume that x86 hardware will still be offered for another two years and supported for at least another 2 beyond that.

Microsoft could be on top of this but made several mistakes with ARM with Windows RT and the rest. But the fact is that > 99% of the Windows world is x86 and this isn't likely to change soon. More important was realising that Windows Mobile wasn't worth the effort (cf IBM and OS/2) and the decision to provide good versions of MS Office for IOS and Android, though Outlook for Android really is a piece of shit.

Huawei's UK code reviewers say Chinese mega-corp is still totally crap at basic software security. Bad crypto, buffer overflows, logic errors...

Charlie Clark Silver badge

Re: Can we do this for all manufacturers

I'm not sure how that would help. Just having the code does not automatically solve the problem. I'm all for open source but seeing as the source is provided in this instance it doesn't help.

Also, it's worth noting that static code analysis only goes so far in flagging up bugs.

Charlie Clark Silver badge

Re: Can we do this for all manufacturers

could we do this with every manufacturer of critical infrastructure?

should ve could we do this with every manufacturer publisher of critical infrastructure software? FTFY

Otherwise you have to define which infrastructure is critical and there is no reason why the manufacturers of consumer electronics, cars or anything else should be able to get away with their current practice to seeing if anyone notices when things break.

O2 cuts ribbon on UK's first commercial driverless car lab where it'll blend satellite and 5G signal to stay on the road

Charlie Clark Silver badge

More cars equals more cars, not less

"in getting autonomous vehicles on the road and making the UK's transport network greener."

Although over time autonomous verhicles may make road use more efficient (they will be travelling most of the time unlike meatware driven ones), they will initially simply add to the number of vehicles on the roads competing for driving and parking space. You can see this in any city "blessed" with electric scooters and bike-sharing schemes: space on pavements has become a rare commodity.

EU's decision on UK data adequacy set to become 'political football' in broader Brexit negotiations

Charlie Clark Silver badge

Re: Erm...

The companies providing the data that is being harvested can be sued in the relevant country of operation, which is why EU-based companies will probably stop personal data being processed in the UK until the UK can provide sufficient assurance that GDPR's provisions will be respeced. As for UK companies wanting to trade in the EU: they will also have to conform to GDPR if they wish to be able to continue to trade.

This is one area where GDPR made significant changes over liability and jurisdiction in comparison with previous legislation: it's no longer possible simply to seek the country with the friendliest ICO as Schrems cases have demonstrated and we'll soon see more summary fines for breaches.

Charlie Clark Silver badge

Foregone conclusion?

It was once almost a foregone conclusion that the UK would comply with EU data protection law enshrined in GDPR after the Brexit transition agreement ends on 31 December 2020.

Some people might have thought that but that would have left the ECJ as the ultimate arbiter. Add to this the list of donors to the Tory Party who are desperate to dispense with things like personal privacy, and it was obvious that the UK would try and offer a sop. Won't help though because ECJ's judgements have been clear and consistent on this and it's not as if the UK has anything like the same kind of bargaining power as the US when it comes to proposing fudges. EU companies will not want to risk the potential fines and will definitely seek to move data processing out of the UK, if they're not already doing so.

Who watches the watchers? Samsung does so it can fling ads at owners of its smart TVs

Charlie Clark Silver badge

Not just Samsung

If you've seen any analysis of traffic collected by devices – TVs, HDMI-dongles, etc. – and apps, you'd be less surpised because they're all at it and will be trying to use the data commercially at some point. With GDPR and its siblings, Samsung has the short straw because it can probably not demonstrate that informed consent was given, which is probably why only a few million people will have seen anything, but personalised ads, including product placement in shows are coming to us all, because so much money is involved.

Japan unveils new scheme to speed up adoption of cashless payments

Charlie Clark Silver badge

Re: Mixed Picture

Cash remains king in Japan because people don’t trust the banks.

Especially central banks. In the current era of extremely loose monetary policy, central banks are desperate to be able to devalue money in order to reach entirely artificial and arbitrary inflation targets and this is far easier to do with purely electronic currencies.

Windows to become emulation layer atop Linux kernel, predicts Eric Raymond

Charlie Clark Silver badge

Re: Emulator?

It doesn't emulate a Windows PC but it does emulate the largely undocumented API calls and maps them to the relevant local system calls. Certainly very different than ABI.

Charlie Clark Silver badge

The big problem will always be: tightly integrated GUI or not. The Windows kernel is probably now not that dissimalar from Linux or BSD. But the fun starts with the GUI and multimedia parts for which there is (and there are good reasons for this) still no single, simple system.

But ESR's main point still stands: Microsoft is starting to make a lot of money from its SaaS and PaaS offerings and will be able to keep customised locked into to its APIs for a while yet.

Despite rolling a homegrown translation app with iOS 14, Apple resorts to freebie tool for Dutch Ts-and-Cs waffle

Charlie Clark Silver badge

Re: It should have been translated by a Dutch lawyer

Depends a bit on the relevant jurisdiction. US T&Cs generally rely heavily on extra-terroriality but contain the relevant clauses that cover their butt in case courts in other jurisdictions disagee. E.g. Microsoft's EULA has frequently been considered unfit by German and other courts regarding automatic consent and the right to copy but this hasn't invalidated the agreements in their entirity.

Exercise-tracking app Strava to give away data sweated out after four billion runs, rides and rambles

Charlie Clark Silver badge

When is a vehicle not a vehicle?

Vehicle traffic has plummeted, while bike sales have soared.

Since bikes are also vehicles this means that a lot of people bought bikes just to look at them. In other news: in many countries vehicle traffic is back between 80 and 100% pre panicdemic levels, in some places even higher as people avoid public transport.

Brexit travel permits designed to avoid 7,000-lorry jams come January depend on software that won't be finished till April

Charlie Clark Silver badge

Re: Dont worry, the pain

The Swiss are currently voting on a related issue – related inasmuch as they're voting on a referendum over freedom of movement for EU citizens. The relevant contract is tied up 7 ? other contracts including freedom of movement of goods and services where if one is cancelled, they're all cancelled. Rather surprisingly polls are around 60 % against cancelling the contract.

Charlie Clark Silver badge

Re: Understatement

Beta is generally supposed to mean "functionally complete, but not suitable for production". Methinks someone might be thinking about how to avoid any liability claims.

Charlie Clark Silver badge

Re: Isn't that particular car park called the M25?

Indeed. Could it be that Chris Grayling/Dido/Hancock/Williamson < insert name here > really wasn't that incompetent and just acting under instructions from a lower power?

NHS COVID-19 launch: Risk-scoring algorithm criticised, the downloads, plus public told to 'upgrade their phones'

Charlie Clark Silver badge

Re: At this time, what's the point?

Yes, but what was the proposed solution for the spike in the area concerned? Close the pubs at 22:00…

Charlie Clark Silver badge

Re: "Smartphone apps are the best way to provide that tracing need"

€20m for an add on to look after 18m people isn’t actually too bad.

If only that were true… the statistics suggest otherwise. It's going to be one of the many examples of massive overspend by panicking politicians along with PPE: the German government is on the hook for millions due to an ill-considered, fix-priced, open house tender for protective equipment.

because corona is the new carte blanche…

Charlie Clark Silver badge

Re: At this time, what's the point?

That's a disgrace! I got mine last week…

Charlie Clark Silver badge

Re: At this time, what's the point?

We'd be better off with a stricter, shorter nationwide lock down

That's been the theory for months. The UK has had an extended lockdown and it hasn't led to the desired result.

Infection rates are a misleading indicator of risk. Hospitalisation, ICU and death rates are far more important. The more the mortality rate starts to look like that of the flu – yes, I know in the UK it's more than this – the lest justified repressive measures are and at some point the economy will simply no longer be able to pay for them.

Charlie Clark Silver badge

Re: Small houses

Can this app see walls? Or only distance?

No, only signal strength and location. You can do some calculations to try and mitigate propagation and absorption issues but false positives are not considered a problem by the app. And, to be fair, by epidemiologists. All track and trace systems can and should yield false positives, this is fine as long as you also pick up the true positives. The app is an attempt to automate a part of the process and thus increase its scale as well as encourage users to take some of the precautions seriously. I remain unconvinced of the efficacy and I'm sure I'm not alone.

Charlie Clark Silver badge

Re: "Smartphone apps are the best way to provide that tracing need"

Indeed and the numbers from Germany would seem to back this up: 18 million downloads, 5,000 notifications in 3 months in a country with a case load of around 10000 per week. A great success according to the Health Minister, but what else would he say?

BTW. you could, of course, use the same app to map the spread of other dangerous illnesses*. But, having been developed by SAP, this would obviously be an add-on for another € 20 million.

* Apparently, there are indeed other dangerous airborne respiratory diseases! As if SARS-COV2 isn't enough there is something called influenza (or "latin flu") which can also kill people! Run for the hills!

Charlie Clark Silver badge

Re: At this time, what's the point?

Oh you can get them. Just not easily if you need them. But tests are also being carried out on a broad spectrum of the population, including those at risk who are effectively in quarantine. Got a relative who's been tested four times over the last couple of months even though she's got virtually no contact with other people and this despite the evidence* that symptonless testing is not very useful.

* The main reason why it's being phased out in Germany for people returning from places with relative high infection rates.

UK ICO fines biz profiteering from COVID-19 crisis by sending unsolicited marketing texts to Joe Public

Charlie Clark Silver badge

Should really be OFCOM

The virus is spread almost exclusively over the air (a novel OTA update!) so hand sanitisers cannot effectively stop its spread. They may well prevent other infections spreading, just not SARS-COV-2.

On the plus side, the fine seems proportionate and can hopefully be collected. Non-payment of fines has been the biggest problem so far.

Tesla to build cars made of batteries and hit $25k price tag about three years down the road

Charlie Clark Silver badge

Re: Tesla might become an irrelevance

They already do. It's one of the side effects of excessively loose monetary policy that dovetails nicely with "network effects" and "webscale". Tesla currently has sufficient market capitalisation to buy them all. Now.

Charlie Clark Silver badge

Re: Landing rockets was never as hard as people make it out

Ssh! Don't be such a spoilsport!

Charlie Clark Silver badge
Facepalm

Re: Applefying the car

And would neither of them exist, if Toyota hadn't sold its factory in California so cheapy?

Charlie Clark Silver badge

Re: Applefying the car

You may not like Tesla, but it’s pretty much certain that the car of the future, from any brand, will be electric.

Nope. The motors will be electric but I hope we won't be using batteries to power them.

Charlie Clark Silver badge

Re: Investors were less impressed

That's not what was announced. It was more showmanship designed to keep the cost of capital down.

Charlie Clark Silver badge

Re: Not sure about the structure but..

What about the rare earths in the magnets?

Charlie Clark Silver badge

Re: Tesla might become an irrelevance

Actually, the capital markets are acting a bit like national governments and have decided that Tesla is the winner. This means that it has lower capital costs than the competition which will allow it to buy the compeition up. This is likely to lead to very inefficient capital allocation, just like when governments pick national champions, but as long as it leads to a monopoly the investors will be very happy.

Charlie Clark Silver badge

Re: Applefying the car

Hydrogen has its own problems. We need something more fungible and that doesn't encourage arbitrage: hydrogen at the moment is being produced by burning fossil fuel.

Charlie Clark Silver badge

Re: Applefying the car

This probably isn't going to hack it in India and China, where the standards of driving are pretty appalling and it's just assume that cars bump into each other all the time.

And this is the biggest problem you can think of? Apart from lumping China and India together in a way no one else would, you seem to have neglected things like charging infrastructure. India can't provide enough electricity as it stands at the moment and certainly doesn't need more coal-fire power plants (the current ones of choice) that would be required for electric cars.

Swift tailored for Windows no longer folklore: Apple's programming language available for Microsoft OS

Charlie Clark Silver badge

Performance

It's also significantly faster than Python when properly tuned.

While in general this is true because Swift compiles the code, when working with something like TensorFlow, about which the paragraph was based, this is likely to be less relevant as all the heavy lifting will be done using the compiled C++ code of TensorFlow.