The unmistakable need for datafication

datafication

Since the term big data started this big wave of everyone turning to data as a resource, many companies jumped on board. But it’s easy to utilize data when you can precisely point it out or quantify it. What happens with all the events that you previously couldn’t pinpoint? This is where datafication comes in.  […]

Data veracity – why should you never forget about it

data veracity

Data, in itself, has many characteristics and challenges, especially in the world of big data. Those who utilize or collect data know about the hardships it brings. That’s why there are some widely known descriptions and parameters of data where certain characteristics are described for better management. One of the best examples are 5 V’s […]

How to manage the pull of data gravity

data gravity

If you are an enterprise company or an entity that either generates or collects enormous amounts of data, then you must be familiar with the fact that the more data you have, the more you’ll add on. As soon as you recognize the value of data in your everyday operations, you will see that data […]

Data fabric and its tech details

data fabric

Welcome to the final post in the data fabric series. So far we introduced data fabric and talked about the business benefits it brings. Now it is time to look at technical questions that may come to mind as you explore the concept of the data fabric. Integration With Existing Data Systems Unless you are […]

Promoting data democratization and governance with data fabric

data fabric

Lately, our colleague Valentina Dugan created a great post explaining How to tackle data security and concerns. Some key terms she covers there are unauthorized access, compliance, data masking, and data democratization. I couldn’t have imagined a more perfect backdrop for data fabric, the topic I’ve been wanting to write about for the past few […]

Data ethics and why it’s important for brand trustworthiness

data ethics

There isn’t a blog post nowadays without someone saying this: “All companies are data companies.” And it’s absolutely true. Data has become the pillar of business society and something people trade with. Information in the digital age has become somewhat of a gold mine. But, with each piece of information comes the hot topic of […]

Data observability in a nutshell

data observability

There is a lot of talk about broad aspects of data science and data engineering, but few mention the importance of quality data and the processes behind it. Data observability is a term that handles data behind the scenes. From infrastructure to data movement, it’s integral to provide an unobstructed flow of information.  Data observability […]

Deep dive into data democratization – the good and the bad

Data democratization

Data democratization is being labeled as one of the most attractive trends in data science and data management for the upcoming years. It’s been raising hype for quite some time and it’s not slowing down. As companies face more and more data, they need effective ways of handling it, but at the same time, they […]

How to deal with loudest guy-driven decisions in tech: Part II

Query migration

We started with issues of a wrong tech choice in part I, and now we’ve come to part II where we discuss our approaches to the best solutions. There were two possible solutions to our problems. The first was to keep Ignite and invest efforts to optimize queries and improve cluster configuration options. These include […]

How to deal with loudest guy-driven decisions in tech: Part I

loudest guy-driven decisions in tech

Technology and the tech era have brought many advantages, both to individuals and companies. But there is no one influenced more by technology and its trends than developers and engineers. Overall trends and hypes influence them and cause constant switchovers between technologies. Technology, especially new ones, can significantly improve an engineer’s life, but in some […]