75 posts • joined Sunday 14th March 2010 18:38 GMT
Re: I had the Sharp PC-1500 in 1992
I have the Casio equivalent - the FX-720P in my desk drawer.
Must get some betteries for it!
Someone else in the office uses his on a daily basis...
Alan, what flaws have you found in DMF?
Certainly satisfies the requirement for everythign going to tape at least twice - you can specify that easily, and also look for any files which somehow have ended up on only one set of tapes. You can easily use disk as a cache layer (which I do).
Indeed when the AWS annoucement of virtual tape libraries on their storage gateway came out it set me thinking on a configuration where you have a local tape library, with the primary copy, and use Amazon Glacier for the second copy. Cost aside, you have disaster recovery.
Re: Brits forgetting their past?
Barrage balloons brough down aircraft as they held up a steel cable, with a weak link at the bottom.
If an aircraft struck the CABLE it would break off and drag the aircraft down.
I suspect an octocpter thing would simply bounce off any cable or balloon.
Sorry - don't mean to be all technical and snidey, and I've never even seen a barrage balloon.
Just think it is interesting to learn the real mechanism of how they worked.
Re: Someone's reinvented NUMA?
AC - thanks for that link to the UKUUG meeting!
wow - that's a bit of history. Look at the speaker list: http://www.ukuug.org/events/linux2001/speakers.shtml
Re: Why ?
Nigel 11, you have it right regarding NUMA systems.
And as you say quite run-of-the mill multi-CPU motherboards are already NUMA systems.
And there are much bigger NUMA systems out there!
Install the absolutely great tool 'hwloc' from the OpenMPI project
You can get a graphical display of how your system is laid out.
Assuming you are running Linux, install the 'numactl' package and use
"Using just (!) 21 SKA12KXs to reach an overall 1TB/sec of throughput."
If this seems a huge amount, look at the Square Kilometre Array telescope - which will generate terabytes of data per second.
Re: 61 cores meh
"In order to levellerage the raw power of this intel kit then you need a OS and apps optimised to run on these 61 cores, cerainly not something that is availible off the shelf."
Sorry to be a Linux fanboi (Iam actually), but Linux runs on hundreds of cores on SMP machines already.
Applications already can scale to 1000's of cores - OK I'll give you the 'optimised' quote, but you already have applications running on multicore SMP machines.
I remember getting a copy of the Morris Worm in an email - yes I am that old!
It would either have been on an IBM Bitnet account or a DECNET email address.
Gogling also proves that I might be remembering wrong - a REXX based virus which affected BITNET precedfd the Morris worm (writing viruese in REXX!)
and yeah, that is some Unix beard.
Re: A NAS by any other name...
" NAS is ... useful! These don't even have that - unless you have no directories on your filesystem and you name all your files like this:
Yes, but it is an object store. Those are unique IDSs which identify - objects. such as digital photographs (or whatever). The metadata about the photographs is kept in a database.
why should we have meaningful filenames and a meaningful directory structure in this day and age?
For instance irods:
Re: Approaching write once storage.
"Which some goits translate as "in their original data format and media" - which means I have ~2000 first generation Exabyte cartridges around that said Goits won't let me throw away, despite not having an Exabyte tape drive to read the damned things (The data all fits on one LTO5 tape, of which there are several copies)"
Agreed. I have been through a transition from LT03 media/drives to brand new LT05 abotu two years ago - happily remarkably easy on our particular HSM setup (SGI DMF).
But I do agree - its the lack of functioning read devices which will render data unusable.
One woudl hope (yeah, I am laughing hollowly too) that this new generation of object stores would support transparent migration onto new technology, whether or not it is spinning drives, moving tapes or solid state or whatever. After all you just have to move the object, right?
And yeah, I'm I don't believe it either, but you can hope.
Re: Approaching write once storage.
Herby, you have it.
Also consider tape as storage for this use case - cheaper and doesn't need power till you come to read it.
Also, if I'm not wrong, the UK research councols say scientific data is to be kept for ten years.
Thats a LOT of data.
Object stores are the future
Object stores are the future.
Scientists and engineers care about their DATA.
They do not care a jot about IT types rattling on about LUNs and SANs and choice of RAID levels.
Re: Not totally convinced
You don;t back up very large data stores (ie petabyte and larger sized collections of data). You keep two copies of it.
You cannot back it up. (OK, tehnically you COULD - but you might as well be making that second copy).
Re: interesting, but ...
As Dave says, Infiniband already has low latency.
I wouldn;t know the exact figures for these particular Mellanox cards.
Also interesting is that you can extend Infiniband links over campus and 'metro' distances using fibre cables with active cables. Look up 'Luxtera'
Re: What a truly advanced civilization would do
"Of course, the proper fix would be to adjust the rotation of the Earth to stay in sync with the atomic clocks!"
Easy-peasy. Take some of those surplus Russian atomic bombs the equator, up a high mountain. Maybe Mount Kilimanjaro? Set them off.
Job's a good 'un.
See Project Orion for references.
I say scariest - by that I mean scariest at home.
A real scary incident when I brought an Oracle RAC cluster online at UMIST and blew a 100 Amp fuse,
The sparky said the fuse had actually caught fire.
cue entire machine room filled with bleeping alarms and scurrying techies.
Yes, their infrastructure had real (very big) fuses and not circuit breakers.
Scaryiest tech thing that happened to me from a powercut was when I had an old Epson inkjet printer.
Powercut at 2am, in the wee silent hours. Power comes on and printer runs a self test, which creates a hell of a racket. Had to peel myself off the ceiling I jumped so high in fright.
Re: They had a good small device
I had a Dell Streak. MArvellous device - well ahead of its time.
Sadly the screen cracked, and it is no more.
A good replacement is the Samsung Note.
I'm not sure how well the screne copes in bright daylight. A colleague similarly wants a device for use in gliders. Do you know what the specifics of the Streaks screen were which made it good for daylight use?
Re: New trans-oceanic cables in use?
Gigabit OVER CAT5/6 may have distance limitations of about that (I stand to be corrected).
For 10Gbps (never mond 1Gbps) over FIBRE it is circa 300 metres for short range, and a lot, lot longer for long range. And that's 10 Gbps I'm talking about.
(Off the top of my head 10Gbps/Infiniband over CX4 copper is limited to 25 metres)
Guess who had his head in wiring cabinets this morning?
You can now buy fibre cables to extend Infiniband across campus distances using fibre.
Take a look at SuperJanet, Internet II
or if you are in the movie industry Sohonet http://www.sohonet.com/
Re: Yeah OK, maybe the number of plaudits are being a bit overdone
Engineering pays the big bucks? News to me.
I have a PhD in physics and I work for a well known engineering company.
I get nowhere near big bucks. I'm laughing hollowly.
Talking about wind tunnels, I once was int he machine room of a UK aerospace company (well, there are not many to choose from...)
I noticed a VAX sitting there quietly - still in use as a data acquisition machine for the engine test stand I was told. A few years ago now I admit.
My first machine
I may have said this in an earlier article.
First machine I ever used was a PDP11-45 in my fathers research unit.
Learned FORTRAN programming at a very tender age (which may explain a lot about my subsequent career, and programming!)
Makes me feel good though - who knows I might still have a job at retirement age resurrecting those skills!
Re: Commodity systems demand a strong, free OS
95% of Top 500 systems run Linux int he list announced at ISC.
I Agree with you though - SGI UV 2000 for instance can run Windows.
Re: Fault finding
I slightly disagree with the point about Linux not having comparable trackin of memory errors.
I do agree that you are right - generix X86 hardware will never come close to having that grade of error logging.
However, my systems have ECC memory and log memory errors quite well.
That's sad news.
VMS was really good - as the article says they clustered together easily.
When I was a graduate student at CERN my experiment used VAX clusters - we got to the bigegst size you could run (somewhere near 120 machines if I'm not wrong) and then started on the next!
In the later days we were using Alphas in the clusters also.
Wrote my thesis on a Vaxstation 3000. Sniff. I still have it on a TK50 tape somewhere!
Re: sysadmin that monster
Morten, I agree with you.
I work in HPC on current SGI systems. I really don't think systems like that ever run on massive numbers of cores except for those hero runs to get the HPL number. But I wouldn't know.
And yes - checkpoint and restart. The more blades you have in the cluster, the more likely one will fial during a computation.
Good idea - good comms
This is a damn good idea.
The Stratford site has excellent transport links of course (including the International station).
Also very good comms were put in for the Olympics - I remember meetign wto BT techs happily terminating rolls of CAt5 out in the sunchine in the Olympic Park during the Games.
I thought that the Olympic Press Centre was slated for use as high tech offices anyway?
Developers developers developers
Last year Google had 400 million Android activations in 2012, now it's 900 million. "We couldn’t have got there without developers."
Did he bound aroudn the stage screaming Developers! Developers! Developers! when delivering that statistic?
Seems like a missed opportunity....
Re: Welcome home Commander.
What you said.
Reawakened my interest in space.
Beer, as Cmdr Hadfield hasn't had one in six months.
Re: Must ask
Chickpeas? The bloke is living inside a converted plastic water tank. Which will be almost airtight. And you expect hom to live off CHICKPEAS? Its dangerous enough living on storm-lashed Rockall, without the risk of suffocation.
Storage California - you can Check Out but you can Never Leave...
Regarding your point about backups, you don;t back up huge amounts of data in a big store like that.
You keep two (or more) copies, hopefully in distinct locations.
Sorry if that is me appearing to be aggressive - I run an HSM system, and backups consist of backing up the 'stub' files on disk. you then keep two copies of the data on the slower tiers.
Sorry to say it - this is a pretty scrappy article. Not well thought out.
You leap about between discussing object stores, and then comparing them with the underlying technology - you mention 'tape' several times. The actual mechanism for storing the data is separate from the data.
I was at a talk recently by DDN and was very impressed by their Web Object Store.
Similarly a lightning talk by Hitachi at Cloudcamp on object stores. It is an idea whose time has come.
Re: The board has rounded corners
Rounded corners are so it fits into an Altoid mints tin.
Those tins are the traditional case for US breadboard electronic projects.
Re: Hands up, who's not heard of HL7 (another set of standards from the 1980s)
Look at the history of HTML and the Web - at the time there were office systems and information retrieval systems which ran on individual platforms (IBM Profs for instance).
Berners Lee developed the standard for exchanging the information - and produced DEMONSTRATION web browser and web server instances. You DIDN'T have to buy a NeXT computer to use the Web - allt you needed was something which parsed and displayed HTML.
Nail on head
I used to work in a teaching hospital, at the time when the NHS IT project was starting.
I completely agree with this article.
Re: Whats the I/o?
SirDigalot, your comment about a power station is right on the money.
There is a lto of discussion on supercomputing lists re. the push to exascale - not because the compute power is impossible but because of the power requirements.
Re: Can't wait for the software!
Yes. but the problem is getting that retail sales data/industrial sensor data into and out of the GPUs.
You still have to have a very capable system which can read the data from disk and display the results.
Just throwing lots of flops at a problem isn't the stotal solution.
Don't simply blindly expand the capacity of disk on your SAN.
If you are dealing with big datasets (and I do) you should look at a Heirarchical Storage Management system.
You can select a secondary tier of cheaper SATA disks, or a tier of MAID (didks which automatically idle down when not used) and a tier of tape in an automated library.
Less often used data will be pushed to tape automatically.
Re: And how do we get at the existing stuff that's buried in various sealed sites?
Well then - why not build the new molten salt reactors on these same sites?
The sites are already there, and have experienced staff nearby, plus the waste does not have to be transported over a long distance. Existing sites will also have the high voltage generator sets and transmission transformers/wires too.
"And the business based in High Holborn London. "
"Recruitment is a challenge"
Well there's a surprise - everything OK for those at the top who are drawing large slaries and can afford that nice place in Clapham?Notting Hill.
But you want recent graduates to work for you in central London - are you paying them a decent enough wage to be able to afford to rent a place and afford a Travelcard?
Or are you jsut whining that they won't work for peanuts and live in a shed.
Re: The "minor" option for my degree:
JCL? Z/OS ? I used to do a lot of that - well MVS and VM/CMS when I were a lad!
I agree with you re JCL - it IS a throwback to punch cards - because, err, well, the machine expects to be reading punch cards. I can also use a punch card machine.
Maybe I should revive my JCL and start earning those big bucks!
Hundeds of thousands of unfilled vacancies?
I am laughing myself silly.
So where then is the law of supply and demand - why aren't huge salaries being offered for all those oh so desperately needed people to fill those vacancies?
Re: Don't forget 'sar' and 'ksar' and mpstat
+1 for kSar
Its been very useful to me on many occasions - such as users saying 'my machine was very slow last night' and you can show them a graph of memory being used up or huge network loads.
Beer, because its Friday afternoon.
... but ifconfig still only shows the loopback adapter. This is because the sysconfig networking scripts (located at /etc/sysconfig/networking-scripts/ifcfg-eth*) haven't been updated with the new MAC address.
Probably slightly cowboy, but you can use the udev files to associate MAC addresses with eth0/1/2 etc as you say, then in the ifcfg-eth0 configuration files not use a MAC address - ie once udev has sorted them out you just have ifcfg-eth0 not tied to a MAC address.
Someone will tell me that the world will end if I do this, but I've been happily running systems like this for years.
Re: A few things
"All you have done is spout about your nuclear imaging (a claim that cannot be verified)"
Errr... it is a claim that certainly can be verified.
Damned if I'm going to bother to name the company on here, but its on my CV.
And I worked in the medical physics department at a London teaching hospital for several years, and was the computer manager at a brain imaging unit it the same hospital.
If you think thats unverifaible, so be it.
Re: Medical equipment, don't make me start...
"As regards test results (ie images etc). These are transient because it's generally not the result that's important, it's the interpretation of the result, in conjunction with other diagnostic information that gives your doctor the information he/she needs to direct your healthcare."
Absolutely agree. Very well put.
What we're missing here is the process - a scan is ordered by a clinician, patient turns up at department, and a lot of digital data is gathered. That dat is kept on disk (in this case on a MO disk, if I remember the capacity being a whopping 80 Megabytes).
The data is kept in digital fomat so that a consultant can view it, and interpret it. The consultant will dictate a report with his/her findings. And remember it takes years to train as a radiologist.
It is the report which is the important part, and this should be what you think of as your "medical records" - and should be kept.
I don't see what the fuss is about keeping all that raw data - there isn't the storage room for it, or the need.
The data IS kept for a reasonable amount of time - after all you might be in hospital for months, or be undergoing (say) a cancer treatment. It is useful to compare the tumour size pre-and-post treatment (I'm sure there are many more examples). But eight years later? No.
Re: A few things
Easy for you to say that Anonymopus coward.
" This is why one should never use proprietary formats for data."
Have you ever read data off a brain scanner?
I have - I have worked in medical imaging departments, and for a nuclear medicine company which maintained scanners.
I ahve worked with Siemens and Philips gear, and with GE probably but I forget that.
So you buy a million pound brain scanner, dig out your basement, install it, install a cyclotron next door.
So you're then going to say to the doctors that they can't see the data off it because CTI Siemens provide the data in their own format?
Of course, hat you do is translate that data into other formats.
there is a standard for nuclear medicine images, which I worked with.
Similarly DICOM for other imaging modalities.
Re: Why do we have records then?
Medical images are routinely stored digitally in systems called PACS. You can take X-rays directly on digital plates, and CT and MRI data are of course digital anyway.
HOWEVER if we restrict ourselves to patient notes for this discussion, have you ever SEEN a patient records department? I have. Do you know what a Lloyd-George envelope is?
When I worked at a leadign London teaching hospital well over ten eyars ago, the head of medical physics asked me to get involved in a project some bright spark had to scan int he entire hospitals medical records.
I ran a mile.
I doubt a project like that has ever successfully been done.
- Xmas Round-up Ghosts of Christmas Past: Ten tech treats from yesteryear
- Analysis Microsoft's licence riddles give Linux and pals a free ride to virtual domination
- Review Hey Linux newbie: If you've never had a taste, try perfect Petra ... mmm, smells like Mint 16
- I KNOW how to SAVE Microsoft. Give Windows 8 away for FREE – analyst
- Geek's Guide to Britain How the UK's national memory lives in a ROBOT in Kew