Subscribe / Unsubscribe Enewsletters | Login | Register

Pencil Banner

How to hire for the right big data skill set

Sarah K. White | June 23, 2016
Hiring the right data scientists, analysts and engineers can be a daunting task. But with the right strategy, you'll be able to find the great candidates in no time.

Data science is a hot new industry, but what skills and background do you need to break into the field? Essentially, data science, data engineering and data analytics are broad -- and sometimes ambiguous -- terms that describe a litany of skills and job titles in the world of data analytics.

"The title of 'data scientist' is broadly applied within different organizations, making it difficult to provide a complete and noncontroversial list of required skills. At a high level, a data scientist needs a mastery of the tools and techniques to access, transform, analyze and leverage the data of their organization," says Kyle Polich, principal data scientist at DataScience.

If your company is looking to hire data scientists or analysts, it's important to know what you're hiring for. Data jobs often encompass a lot more than just data; there are people specifically dedicated to each stage of the process from collecting, to warehousing, to analyzing and to using that data to transform the business. Ultimately, a good data strategy relies on a number of qualified individuals who can write algorithms, manage and collate data, interpret the data and communicate it to key stake holders.

Data warehousing

Warehousing data is a task in and of itself, because the more data you have, the more servers, hardware and third-party services you will need to store it. However, data warehousing skills include more than just the ability to capture and store data, it's also about interpreting the data and possibly even making critical decisions and tough choices to make sure data retrieval and analysis can remain cost-effective, according to Polich.

"Data warehousing roles, which focus on Extract, Transform and Load (ETL) and data ingestion, are generally distinct from data science roles. The former focus on capturing, storing, and pre-processing the data while the latter focus on extracting insight from the data," says Sham Mustafa, CEO of Correlation One, a company that is focused on matching data scientists and hiring companies.

Ashish Thusoo, co-founder & CEO, Qubole, a cloud-scaling data processing company, has worked in data science roles throughout his career. For him, one of the most important skills around data warehousing includes "understanding the capabilities and limitations of the technology." Beyond that, he says it's crucial that employees working in this area also understand how to translate business requests into SQL queries, so that data can be quickly retrieved when it's needed.

Essentially, hiring the right person for data warehousing will mean finding a candidate who can strike a comfortable balance between understanding how to capture and store data and how to meaningfully interpret it, rather than being completely focused on one or the other.

 

1  2  3  4  Next Page 

Sign up for Computerworld eNewsletters.