131 posts • joined 20 Nov 2009
Re: And it comes with a free unicorn.
Damn it! I missed out on writing about the free unicorn? They didn't have a unicorn at the show, or maybe it was in one of the customer-only whisper suites.
The way I understood this is that we're essentially talking about using the entire set of drives in the array (48? 64? or more) to rebuild the failed drive. This would be a lot faster, of course, then having five or ten drives rebuilding a single drive.
As to the internal bandwidth and the limitations there, you make a good point. However, I'm pretty sure we're talking about SATA 3 rather than SATA 2, and PCIe 3 as well. I'm not positive on these points, but it makes sense to me that they'd use the latest/greatest on this new storage box.
Re: Computer Scientists
You guys both make some good points, but these Student Cluster Competitions aren't just about putting together computers and racing them. These kids have to run real scienfitic apps, running the gamut from weather forecasting to molecular dynamics to financial modeling. In order to do this, they have to investigate and understand the apps and the science behind them. Many of these students are majoring in scientific fields, which, as you point out, require some fairly deep knowledge of computer science.
The laptop was not connected to the same speakers as the desktop. The audio on the laptop was playing through the laptop speakers and headphone jack. Hmm....I didn't check to see if both computers were playing the SAME audio at the same time - that was an oversight on my part, probably caused by panic..lol
Re: Poorly Solved
Yeah, you're right. I may not have a solution here at all. But so far, so good. The rest of your post scared me to the point where I almost peed my pants. But it's not anything that I haven't been wondering about.
Very interesting situation with your twisted wires picking up boradcasts. In my case, I could hear enough audio snippets to realize that they were coming from locations very far away from me - not local TV or radio stations.
You should charge admission to your demonstration of your audio problem. If it confounds and amazes co-workers, they should pay at least a little something for the experience, eh?
Re: Rootkit playing tunes?
You make some great points above. And I was scared to death about what the rootkit might have been doing while it was distracting me with the audio. I did look at my network traffic on my switch (also 16 ports to support desktop computers and home infrastructure). I didn't see much, if any traffic coming out of the infected system, which at least sort of put my heart at ease.
I did boot the system from a recovery DVD and repair the O/S as part of my own troubleshooting. It didn't seem to work, or else the virus reinstalled itself upon boot.
I wish I had the skills to use a debugger and those kind of deep diagnostics you cite above. That would have come in very handy back then!
Re: Tired of self professed "security experts"
Damn it! Where the hell were you when I was going through all of this??!! I could have really used your help and would have paid handsomely for it.
Just to keep things straight, I wasn't going through some random security auditors or 'experts'. I contracted with a major security firm to have them fix this box. From what I could tell from watching what they were doing on my screen, you're absolutely right, they were primarily using the same tools that I was using before I contacted them.
I didn't see any evidence of them using a debugger, or checking processes, or doing any sort of deep dive into figuring out how this virus functioned. To me, I figured it would be a matter of finding out what process is compromised and then eliminating it. But, according to them, it's not that easy these days. They said the virus code could have been buried inside other processes - which would make finding it more problematic.
On the other hand, there was SOME process that was pushing audio to my sound card, would it be impossible to trace that chain back and see what was issuing those commands?
Ok, here we go, this is more like it...lol. The charge was for $100 per month and it was with one of the biggest and most reputable security firms in the industry. So i wouldn't put them on par with monkeys - unless you know some really smart and experience monkeys.
I ended up reflashing back way more than a few days and that seems to have solved the problem, while losing valuable work at the same time, of course.
You're right that my NAS wouldn't have helped me if someone had come in and encrypted all the files on the server and NAS box. That sort of 'data kidnapping' scheme is pretty tough to protect against. How would you do it?
Re: Your own ethics?
Hold on, wait a minute. I didn't receive ANY benefit from their services. I thought I made this clear in the article, but maybe not.
The security company mainly just cost me time. They didn't tell me anything I didn't know. They weren't able to identify the virus, how it got into my system, or fix it. The did tell me that my current security status was top notch and exactly what they would recommend.
In their pitch to me, they said that they would certainly be able to fix my system without any intervention on my part. Was it an ironclad guarantee? Nope, but no one gives those types of guarantees on these types of services. The problem here is that they simply didn't have the experience or tools to handle my particular problem. Since the reason I purchased the subscription was to solve this problem, I feel that canceling it was fine ethically.
Re: This may be a really obvious question
Great question. Here's what I observed:
1) I couldn't seem to find a specific process that fired up when the audio was active. The process list (hundreds of processes and services) looked identical when the virus was 'sleeping' vs. when it was actively playing sound. I also didn't see any particular process taking more memory or CPU than normal.
2) The audio played even when there wasn't any other application open and without me doing anything that would prompt a system sound. There also weren't any system issues that would cause an alert - at least nothing I could find with deep hardware and software scans.
3) The audio was unfamiliar to me. It wasn't playing anything that I had ever heard before (nothing from my media library, for example). It sounded like it was current or cached versions of web broadcasts, but the snippets weren't long enough for me to figure out exactly what they were.
Re: Sorry if this is a stupid question....
NO! Not a stupid question at all! I spent hours wondering the same thing. I also closely checked network activity when the virus was active to see if it was busily sucking files out of my system or feverishly sending commands to a bot army. I didn't see much of any outbound network activity at all, and very little inbound traffic too.There also hasn't been any problems that are identity theft related either.
I think whoever penetrated me (whether I was targeted or it was random) probably used some code that was both sophisticated and amateurish at the same time. It was able to penetrate multiple layers of protection to get into my boxes and hide itself, but the payload didn't do much of anything other than annoy me.
On the back-up issue. I would heartily suggest that you keep more than three weeks of back-up images. One thing I didn't mention in the article (I didn't want to make it even longer and more tedious) was that one of the first things I tried was to use Windows System Restore to get back to an earlier version of the system. No luck on that, even with going back weeks in time.
So if I didn't have as many back-images as I did, I would have been even more screwed than I was. Storage is cheap these days, you can get a 3TB drive for less than $100. Get one and fill it up with back-ups, it's cheap insurance.
Re: In concerns me that this is the case
I see your point about remote vs. keyboard access. But from looking at what they were doing on my system, it looked like they did do a boot from an external source into a proprietary shell o/s.
It didn't work, of course. Which sucked. But is reformatting the only solution here? That's going to take a lot of time - longer than it took me to reimage a spare drive. I get your point that there's every possibility for reinfection, but I would hope our current set of tools can do at least a decent job of ensuring that your existing files aren't compromised.
I took a quick scan through the lastest Top500 list and, not surprisingly, didn't see any Itanium based systems on the list. It's not surprising, since these boxes were mainly sold to customers who need large SMP instances. There also aren't very many HPC apps available for HP-UX, which is a huge hurdle as well.
Yep, that's another great point and something that I've been considering. Most of the industry system components are manufacturered. Systems vendors today are much more assemblers and integrators than anything else. So how much difference is there really between a Lenovo branded system or a rebadged IBM set of boxes? Technically? Probably none. But according to procurement rules, probably it's the difference between a completed deal and a quick rejection.
Re: IBM will slide further down
You're making a great point in your comments above. Lenovo will absolutely face problems with trying to replace govt. and lab systems. How much of a problem? I'm not sure yet but am asking around. I'll post a follow up story as I find out more. Thanks for the great comment!
Crappier? Eh, I don't agree
You think their PCs have gotten crappier over time? Hmmm...that hasn't been my experience. I had an original ThinkPad when I was with IBM for a few years in the late 90's until 2001. I was impressed with the design and durability - very efficient box. Just for fun, I priced out my business laptop as if I were buying it retail and was shocked to see how much the thing would have cost me.
After leaving Big Blue and starting my own company, I had HP, Acer, Fujitsu, and Sony laptops before giving Lenovo a try again. While the other laptops worked fine and were functional, I found that the Lenovo had that same durability and functional design that I remembered from my first ThinkPads. Moreover, when I started buying Lenovos, the prices had reached parity with the rest of the industry.
So, from my perspective and for my needs, their laptops are a cut above the rest. I haven't tried every laptop out there - or any other brand for the last three years, so maybe things have changed.
Re: "Successes? Oh, we've had a few...........
Ok, that one made me spit Sprite Zero all over my keyboard....great job....lol
Re: Forgot one thing
Hmm...I'm not so sure it was as big a swap-out as you're saying. There are still a boatload of Lenovo folks in Raleigh, NC. How many of those are legacy IBM, I'm not sure. I also know that they've hired a number of IBM'ers to staff their earlier server efforts.
I seriously doubt that the carnage for the people moving from IBM to Lenovo will be anywhere close to what you're saying. They're picking up an ENTIRE division of completely new products. I'm assumnig that they truly do want to be a power in the x86 server market. That said, they can't afford to blow out the people they're going to need to market, sell, service, and design these boxes. It just doesn't make sense to me.
Unpaid internships suck
I hate the idea of an unpaid internship. If the intern is providing any sort of value, then pay them at least something to recognize that fact.
What's great about these student cluster competitions is that these kids are finding good opportunities out there - whether we're talking internships, advanced degrees, or full time jobs. I have another webcast coming up that talks with Cray's John Lee about this....
It's a short video, but longer than zero. It's working fine now - at least it did for me.
Not sure what you mean....
...but the name of the university is truly "National University of Defense Technology". These are the same folks who built/own Top500 chart topping boxes like Tianhe-1 and Tianhe-2
I actually like CC
I'm a guy who needs to use a fair amount of the big Adobe tools like PS, Premiere, After Effects, Audition, and Illustrator. Before CC, I had debated buying either the package or the individual components I needed, but had always balked at the $3,000+ purchase price and then the extra money to stay current (assuming I wanted to stay current).
For my $49 per month, I get everything I need. The crossover point between me being ahead of the game financially is 61 months (3,000/49), meaning that I'm ahead of the game for five years. For me, this is a better deal than having to put out three grand to get what I need.
My analysis would be different if I had already owned any of these admittedly expensive tools. But in my case, Adobe's CC brought them a new customer that they probably wouldn't have had before.
Re: Why stop there..
Good idea, but that would have reduced the hyperbole in my sentence by perhaps as much as 37%. My goal is to provide all the information about the competition, but with as much hyperbole as I can possibly pack in. All of this at NO additional charge to you, the reader.
Re: 26 amps?
Ahhh...damn it, I should have mentioned the voltage! We're talking 26 amps at standard US power of 110 volts. They have two 13 amp circuits they can draw from. Sorry for omitting that key fact and thanks for pointing it out to me.
Re: And still
I see what you mean, but I remember the days when we had SMP systems using buses and crossbars with flat flat access times (ie. non-NUMA). The system I'm most familiar with, the Sun E10000, had a 16x16 crossbar with 1.3 GB/sec bandwidth at about 550 ns latency. The E10k scaled like a scorched weasel (which is pretty good) when compared with the systems of that era.
Today, you can get 56Gb FDR Infiniband that offers 6.8 GB bandwidth at around 700 ns latency. That's not too bad at all, and should be enough to ensure reasonably linear scalability on a good portion of workloads.
In any case, a SMP system should be able to scale better than a cluster running message passing. While sitting here writing out this reply, I can't think of any application that would scale better in an MPP system vs. SMP, but I could be wrong.
Re: And still
Yeah, very good point on that. And this solution should be a hell of a lot faster on those types of workloads vs. message passing on clusters. But we'll need to see some number to really know for sure.
I expect to see this kind of technology filter down into enterprise fairly soon. ScaleMP is part of the secret sauce in SAP's Hana in-memory analytics product set.
End of an era
I've learned more from reading and talking with TPM than I ever learned in school. (Hmm...is this a comment on TPM's guru-like knowledge or the poor quality of my schooling? Maybe both?)
I'm glad that he's staying in the business and hasn't pulled up stakes to pursue his other interests. Some of you might know that Tim is a mean home brewer. (He's actually a mean everything, but what I mean in this case is that he has some serious brewing skills.) As he mentioned in the story above, he is a master of the holiday fruit cake. His 2012 edition won the prestigious Olds household "Best Mailed Food" award for that year.
I know that Reg readers will miss his heaping helpings of tech news and views. I'll reading him in The Reg as well.....
Re: Background or explanation
Here's the problem: there are now three major international student cluster competitions, each with 8+ teams, 5 or more apps, and three or more winners. I probably end up writing somewhere around 20-30 articles for each competition. I can't face a life where each and every one of these stories has to contain verbiage summarizing the entire competition. It would be way tedious to read and more tedious to write.
The solution? I wrote up a comprehensive guide to Student Cluster Competitions earlier this year. That article (here: http://www.theregister.co.uk/2013/02/14/guide_to_student_cluster_compos/) explains pretty much everything you need to know about these events.
While that article isn't linked in each and every story, the stories that I have linked to do have a link to that original document. (Now that's a great sentence, very clear.) . So, like the other posters have said, if you're interested, check out the links - they have the details.
Re: Background or explanation
Hey Steve....I did write an article about the configurations, you can find it here: http://www.theregister.co.uk/2013/06/24/isc_13_cluster_comp_configurations/
We didn't see any exotic cooling this year, although at least one team had signaled they might try for a liquid cooled box.
I'm going to do little deeper dive into the hardware, looking at node count, core counts, memory to core ratios, and whatever else looks interesting. Look for that soon.
Re: Colorado is also home to the NIST
I just finished an interview with a couple of WRF experts where we discussed the app and how to optimize it. I'll have a link to that interview in a near future blog post here.
If you're looking for past Student Cluster Competition results, you can find my articles by searching my name on The Reg, of course. This stuff goes back to 2010. If you're looking for all of it, you can also visit www.studentclustercomp.com - that's a new portal site we built to be a one-stop-shop for all things related to the Student Cluster Competitions.
That's a story I've been pitching to Reg editors for a few years now, plus additional coverage on other models who are trying to make their way in the rough and tumble world of HPC. In order to do this story justice, I'd need to travel to various locations and have the resources to blend into the world of the super model. So far, I haven't had any luck convincing them that: 1) this is a good story for The Reg and...2) that I'm the ONLY PERSON who can pull this off.
I'll keep trying, though.....
As a long-time resident of the Portland tech suburbs, I've watched the city spiral down to the point where it can generate it's own field of hipness and pretentiousness without needing any inputs from outside the city limits. For the unitiated, take a look at any episode of the TV series Portlandia....while it's put forward as a comedy, it's much closer to a documentary.
Guess I'm the exception....
..but Adobe gained me as a customer with this package. I run a small business and found that I needed Premiere, Photoshop, Audition, and Illustrator to do our videos and other projects. I had a definite need, but couldn't quite justify spending $1,500 for the Premium Product suite or just buying a few of the products ($650 for Premiere, $600 for PS, $500 for Illustrator, and $350 for Audition).).
For $50 per month, I get access to all of these products plus everything else I would ever need. I also get support and won't have to shell out more $$ for upgrades.Over the time I've been with the program (about a year now), they've added more products to my subscription, some useful to me, some not.
Before Creative Cloud, I used point products (Adobe PS/Prem Elements, Audacity, others) and was constantly frustrated at what I couldn't do with them and the amount of time to get over several learning curves.. The Adobe products are extremely high quality and are well integrated. This has saved me a lot of time and I've been much happier with the results.
On a straight financial basis, my $1,500 outlay would pay for 30 months of Creative Cloud subscriptions, so I would be in the hole on the 31st month of my subscription. But to me, paying $50 per month for everything I need, no charge upgrades, and support is well worth it. And if I find a better alternative, I can convert anything I produced with Adobe to a different format and use it in whatever software I end up using.
Without the Creative Cloud, I wouldn't be an Adobe customer....
...maybe next time? And that highlights a problem with the internet, it's really difficult to find adult-oriented content on it.
Re: What he really means is...
But you're forgetting that the Keppler feature set brings a lot to the table, features/capabilities that will allow service providers to serve up games online that have performance and latency that are console-like. They probably won't be able to offer up enough performance to satisfy the hard core PC gamer, but, over time, will certainly be able to compete successfully vs. xBox, PS, and Wii on both quality and cost. And those service providers will be buying Kepplers by the boat load to make this happen.
Bewitched by trolls....
They switch street signs around the wrong way, change traffic patterns, and the like....which makes it difficult to learn your exact route right away. The only sure way to defeat their efforts is to continually chant a 'Spell of Clarity' while you're driving - which makes it hard to hear the radio.
Re: When drivers don’t pay attention to the road for protracted periods of time, bad things happen.
Thank you, I thought that sentence was one of the very best. Oh wait, you're being sarcastic, aren't you? Ouch....
Re: One of theese days...
Back to shoulder stablized TAPE camcorders? Damn, I'd hate to have to lug around something that size, plus it would be more cumbersome to edit on the road.
I'll use the monopod first and see how that works. I'm using the Adobe Creative Suite and can try using the feature that removes camera jitter in either Premiere or AfterEffects. But I appreciate you taking the time to give me advice on it.
Re: Wow...great stuff
See my comment about, re: "Damn it, I wasn't using a mobile phone!"....After replying to Christian's comments above, I went back and looked at how YouTube handled the shakiness. To me, it looks like it kept doing small zooms in and out to adjust for camera motion. I know that I didn't zoom all that much and definitely didn't make the small in's and out's that seem to be on the video now. Excuses aside, I do really appreciate the feedback and will try to improve the quality.
I also appreciate your comments on the 4k class projectors. I was at another vendor event last week and they recorded the proceedings in 4k. The camera man told me that shooting in Red actually consumed 6x the storage of 1080p (I had expected it to be 4x larger) and filled his hard drive equipped camera pretty fast. But what an image!
Re: One of theese days...
Damn it, I didn't use a mobile phone! I used a Cannon HFM300 on this one. But, that said, I think the auto image stabilization might have been 'off' rather than 'on'. That, plus the fact that I was drinking huge amounts of coffee throughout the day AND kicking my heroin habit at the same time, probably combined to make this video a bit shakier than others. What's funny is that when I uploaded it to YouTube, it asked if I wanted it to take out the shakiness. I said yes, but only watched a few minutes to see if it was posted correctly. I wonder if they magnified my natural jitter somehow?
It's pretty clumsy and cumbersome to carry a tri-pod around a crowded tradeshow floor, but I think I found the solution - the monopod. I'll use it at the upcoming ISC'13 show and see how it works.
Thank God!!Re: Crysis etc..
I was looking at the comments on this story and was afraid I'd have to insert my own Crysis reference, I'm glad that someone else finally did.....
Thank God!!Re: Crysis etc..
I went back to look at the comments on this story and I was thinking that I'd have to insert my own Crysis comment. Thank God someone else did it...
Re: "Do you have employees who habitually bust up perfectly good tech?"
I tried that once...figured I'd get a shiny new laptop to replace the horrible clunker I was using. It sort of worked, but the ordering/delivery process took so long that I had to use a crappy loaner for several months. By the time my shiny new laptop arrived, I had taken a job at another company.
Actually, it was kind of a funny moment, which is why I included it in the video you didn't watch. I also put in a few seconds of landscape time lapse footage to convey the sense of time passage. It was a tour de force of video wizardry. I'm so sorry you missed it, but I'm glad you took the time to let us know that it bored you. It's useful feedback and much appreciated.
Re: See, that's the benefit of a UK sixties education...
My US education in the seventies did cover the metric system but no one figured that we'd ever convert from F to C. The GE guys said the same thing to me as you mention above about working with low mass components. On the 'only -40C, 85C and 40G' point. These guys are building milspec hardware and I wouldn't be surprised if the public specs they disclose vary significantly from true capabilities. There could also be another line of equipment that's engineered to higher specs that they don't take to public trade shows.
Re: Microsoft $$ infusion in Dell
Don't get me wrong...I don't think MS is doing anything for Dell out of the kindness of their collective hearts. MS is going to get a pretty good return on their money for this loan. Also, while banks are now saying that money from MS isn't necessary, we don't know when MS was approached or when they jumped into the deal. I don't know for sure, but I would bet that MS was approached early on, before the other financing was in place, but I could be wrong.
And, sure, MS is going to try to steer Dell into a MS-only product strategy. But giving the loan doesn't give them the formal power to force the issue.
Can't pull it off
It IS possible to pull off the business mullet (jeans + sport or suit jacket) and look good, but I've only seen it done once or twice. I'd never attempt it myself - just don't have the stones. But I did draw a line in the sand years ago when I decided to only wear ties for funerals or formal weddings. For business meetings, the most formal I'll go is a dress shirt, suit coat, and Dockers.
Re: Ms hate
The thing that many seem to overlook is that there are usually good and valid reasons why firms buy technology that some seem to think are archaic. You, and others, seem to be holding up the mainframe as an example of a stupid buying decision. But even today, there are things that mainframes can do that other systems can't do as easily or as inexpensively. The same follows for commercial Unix's too. Unix based system running AIX, HP-UX, and Solaris are highly integrated solutions that do things and have characteristics that can't be duplicated in Linux or other alternatives without a lot of clunging, cost, and risk. Smart phones don't have the same functionality as tablets and tablets can't do the same kind of work as efficiently as laptops. And there aren't any laptops that can handle the same power-hungry chores that come easy to a beefy desktop or workstation.
My main contention is that these competiting technologies aren't exact substitues for each other. Implying that an organization or individual is somewhat thick if they buy a mainfram, commercial Unix box, Windows based systems, or whatever technology you happen to NOT be in love with at the moment is provacative and makes for a fun flame war. But it doesn't have anything to do with the reality that tech decision makers wrestle with daily.
Re: yo have got to be kidding
Keep your shirt on, pal. I'll be providing full coverage of ALL the teams in upcoming articles - with full motion video too. Not just the teams, but the intriguing and wonderful hardware combinations they've put together too.
I always use the US convention....so February 4th, 2012 and from everything I can see, the Chinese Astrology New Year indeed began on February 4th, 2012
- Fee fie Firefox: Mozilla's lawyers probe Dell over browser install charge
- Did Apple's iOS make you physically SICK? Try swallowing version 7.1
- Pics Indestructible Death Stars blow up planets with glowing KILL RAY
- Video Snowden: You can't trust SPOOKS with your DATA
- Review Distro diaspora: Four flavours of Ubuntu unpacked