R. Emmett O'Ryan

R. Emmett O’Ryan is the pen name for an inventor, scientist, engineer, architect, program manager and author who has been living, working and writing in the Silicon Valley since the early '80s. He is a fourth generation Californian.

Is Apache Spark the Next Big Thing in Big Data?

Data Transfer
In any article or blog post, any mention of Big Data usually includes something about Hadoop. When it comes to Big Data, Apache Hadoop has been the big elephant in the room, and the release of Hadoop 2.0 in 2013 made the environment easier and more stable. But even with the inclusion of Impala for querying stored information real-time, Hadoop is still a batch-based system that processes data in, well, batch mode. Big Data processing is said to have three… continue…

Is Julia the Future for Big Data Analytics?

Julia Language Logo
In many Big Data analysis blogs, at Big Data meetups and in the halls of the most recent O’Reilly Strata Conference, one of the most-discussed topics is which language is better for data analysis: Python or R. Some of the talk has even reached “religious” overtones not unlike previous discussions on Windows vs. Linux or Microsoft’s Internet Explorer vs. Mozilla Firefox. So what’s the issue here? Why are Big Data analysts so concerned with what language to use? In my… continue…

Scott Adams: Goals are for Losers

Posted In Looking in Tech
Scott-Adams-Thumbnail
“Goals are for Losers” and “Passion Is Bullshit” are among the messages Dilbert creator Scott Adams shares in his new book, How to Fail at Almost Everything and Still Win Big. And yes, this is a book about Success. Adams is probably one of the most unlikely failures that you’ve ever heard of. And again, yes, we’re talking about Scott Adams. In his book, Adams takes a very personal approach to show how he failed his way to success, but… continue…

Is Hadoop THE Answer for Big Data?

hadoop logo
Are companies and Big Data professionals who embrace Hadoop putting themselves at risk by being at the mercy of Google? In March 2013, after about four years, the U.S. Patent and Trade Office granted Google 10 foundational patents related to MapReduce, a programming model for processing large datasets with a parallel distributed algorithm on a cluster of computers. MapReduce is also the basis for the Hadoop framework. Rather than transfer, assign, or license these foundational patents to the Apache Software… continue…

Big Data Training vs. Education

Eyes in binary data thumbnail
“Big Data is Big Business with many new opportunities for technical people.“ I’m sure many of you have heard something like this. Last year, the Harvard Business Review went so far as to call data science “the sexiest job of the 21st century.” (I actually have this article framed on my office wall as I don’t think anyone will ever again call my job “sexy.”)  My point is: Time and again, we’ve been told that there’s a dramatic lack of… continue…

Sequestration and Its Impact on Big Data

US-Capitol-Thumbnail
Many have heard the word “Sequestration” bandied about in the press, but few seem to know what it means. It refers to budget cuts to federal spending that began on March 1, 2013 as an austerity fiscal policy enacted by the Budget Control Act of 2011. The spending reductions are approximately $85.4 billion during fiscal year 2013, with similar cuts for years 2014 through 2021. Starting the week of July 8, 2013, many civilian federal workers will be forced to… continue…

3 Steps to Protect Your Personal Data When the Big One Strikes

iCloud Logo
For many of us, the data stored on our computers practically defines our lives. As an inventor, computer scientist, software developer, photographer, technical writer and fiction author, the data and information that I produce is extremely valuable to me and to my livelihood. As I have started reducing paper financial records while migrating to electronic records, my data becomes even more important to me personally. So where do I have all my data stored? Well, given that I have 20+… continue…

Big Data Talent Shortage? Is Recruiting to Blame?

Data
Demand for Big Data talent certainly seems strong, but what’s driving it? Some argue there’s a talent shortage, but it seems that the hiring process might play a role as well. Employers may not be asking the right questions in the interview that will help them hire the right candidates. There’s no doubt that the past year has been a wild one when it comes to job opportunities in Big Data. There is a dramatic shortage of Big Data technology professionals,… continue…

New Tools for Real-Time Processing of Big Data

Data
Here’s a little secret about how Apache Hadoop can help in processing Big Data: It does it in a batch processing mode. At present, Hadoop can’t process data in real-time, or even near real-time. What does this mean? For data that is on a file system or in some kind of storage container (like a data base), it is a matter of ingesting this data into Hadoop, then off we go doing whatever processing is necessary to produce analytic results.… continue…

More Big Data Jobs from the Government

Big Data
I know it’s a very unusual day when I get over two dozen unsolicited inquiries for new employment opportunities before noon. That’s how my day started on Thursday and it had to do with employment opportunities in big data analytics, a hot job at the moment. Does a job working with big data appeal to you? Why or why not? Share your thoughts below.  Part of what I do during my day job is use my skills and experience as a… continue…