Big Data

Tools and techniques related to managing and understanding ever-larger amounts of data

Big Data Talent Shortage? Is Recruiting to Blame?

Data
Demand for Big Data talent certainly seems strong, but what’s driving it? Some argue there’s a talent shortage, but it seems that the hiring process might play a role as well. Employers may not be asking the right questions in the interview that will help them hire the right candidates. There’s no doubt that the past year has been a wild one when it comes to job opportunities in Big Data. There is a dramatic shortage of Big Data technology professionals,… continue…

New Tools for Real-Time Processing of Big Data

Data
Here’s a little secret about how Apache Hadoop can help in processing Big Data: It does it in a batch processing mode. At present, Hadoop can’t process data in real-time, or even near real-time. What does this mean? For data that is on a file system or in some kind of storage container (like a data base), it is a matter of ingesting this data into Hadoop, then off we go doing whatever processing is necessary to produce analytic results.… continue…

Beyond Hadoop: Open-Source Options for Big Data Analysis

It’s virtually impossible to read any article about big data without hearing about Hadoop and the NoSQL class of databases. With a potential $34 billion lined up to be spent on big data initiatives in 2013, according to Gartner, it looks like the market is widening to include other platforms and technologies that can tackle the number crunching and analytics that big data demands. For example, you can check out Storm and Kafka. Storm, which was developed at Twitter, is… continue…

The Sex Appeal of the Data Scientist

Couple in Love
The sexiest job of the 21st Century is… Data Scientist. At least that’s what Thomas H. Davenport, a visiting professor at Harvard Business School, says. You see, he describes data science as being a field that’s all about supply and demand. It’s like dating: Who’s sexier than the one you want but can’t find? In an article for the Harvard Business Review, Davenport writes: The shortage of data scientists is becoming a serious constraint in some sectors. If capitalizing on… continue…

Learning Mobile Dev, Web Design in Bay Area

Designer
According to Peter Delevett in “Silicon Valley Finds Its Heart In San Francisco” (linked below), startups are swamping the city’s South of Market region. He notes that there are 4,000 startups in the area and that units in one new Mission District condominium project went for a record $900 per square foot. You can bet many have a strong tech component. With all that concentrated activity in the south end of San Francisco, where do people go to learn to… continue…

The Basics of Data Dashboard Design

Busy Working Time from Bigstock Thumbnail
There are three different types of dashboard design: strategic, tactical, and operational. Each serves a different purpose and a different audience. Lee Lukehart, Chief Data Visualist for SavvyData gave us the run down in his presentation, “The Art of Dashboard Design” at the 2012 Silicon Valley Code Camp conference. Make It Work Before you let a dashboard out the door, Lukehart says think about how others will see it. If not done right, dashboards can be boring, inaccurate or even… continue…

Where to Get a Master’s Degree in Big Data

Data Squares
McKinsey & Company predicts a shortage of deep analytical talent of as many as 190,000 people by 2018, which means there should be abundant opportunities for Big Data analysts and business intelligence experts in the coming years. No wonder universities are coming up with a variety of master’s programs. These new programs are “using business intelligence and other analytical tools to turn social media, sensor, purchase transactions, mobile and other sources of big data into useful information for business and… continue…

21 Skills That Pay Top Dollar – Without Certification

Need a raise? Here are 21 IT skills that pay a premium — anywhere from 4 to 17 percent in terms of total compensation. What makes them even more attractive: None require certification. Big Data Although the demand for Big Data skills varies, early adopters are “willing to pay anything” to acquire and retain professionals with the necessary competencies and Java expertise, according to David Foote, CEO of research and consulting firm Foote Partners. Specifically, they’re looking for expertise in:… continue…

5 Cities Where Big Data Is Driving Demand for Business Intelligence

Big Data jobs focus on collecting, analyzing and interpreting data to help a business further its goals. As the sector grows, business intelligence has never been a bigger deal. So where are the jobs? Not exactly where you might think. IT staffing firm Modis has identified five cities where big data is driving job growth: San Francisco: It’s home to large companies in the retail, insurance, healthcare and e-commerce sectors, all of which rely on an aggressive use of data.… continue…

Analytics Specialists: Pay Attention to SAP HANA [DiceTV]

Cat Miller
SAP is placing a big bet on its in-memory database platform SAP HANA and, as a result, its hundreds of thousands of customers may too. And though the platform’s only been on the market for a year, indications are it’s had strong sales. As a result, the demand for professionals familiar with SAP HANA is likely to grow.