R/Dataengineering - Comment by U/mRWafflesFTW on ”Is Data at Every Company Still an Absolute Mess?”

@tags:: #lit✍/📰️article/highlights
@links::
@ref:: R/Dataengineering - Comment by U/mRWafflesFTW on ”Is Data at Every Company Still an Absolute Mess?”
@author:: reddit.com

=this.file.name

Book cover of "R/Dataengineering - Comment by U/mRWafflesFTW on ”Is Data at Every Company Still an Absolute Mess?”"

Reference

Notes

Quote

It's all shit my dude welcome to the thunder dome. The beauty? Job security. The down side? I hope I get laid off all the time to free me from this horrific nightmare. In reality, every company, even those who tell investors "we're data people", are full of shit and data is just a byproduct. It is exhaust. You're sucking exhaust from the tail pipe of 1970 dodge challenger on cinder blocks in a single car garage.Fix it? In the font end? Are you fucking with me? Why spend a couple thousand dollars to fix it to the left when we can spend a million dollars fixing it after the fact?Everyone is a shit head and everything is awful. The bright side? There's a lot of opportunities to improve conditions.
- No location available
-

Quote

And the joke is that companies also have Data Management departments. Just the same shit, but now it's Managed Shit.As if ownership is the problem. No, it's not.No shit gets reduced by managing it. It will only cost you more because some big consultancy corp is needed to do the maturity assessment (outcome is always a 3 or 4 out of 5) and to do the Data Management framework implementation.And Data Management professionals score big time on the Bullshit-job scale, so they are expensive too.You then have a shitload of shit, but it's managed now. And it is expensive so upper management is happy.Those Data Managers and Data Owners, they then think they need to map the data. So that they have oversight of data they have never seen and don't have any clue of.So they use tools to draw boxes and lines, and more boxes and lines. They map all the data in fancy tools, expensive tools. And they say that stuff is getting too complicated because tere are so many boxes and lines. So we need more Data Managers.At the same time, we hire super cheap data engineers, that produce even more shit, because they lack knowledge and proper schooling. And that freshly produced Shit needs even more Ownership and Management.It is like a complete nightmare. It never stops. And I have a hard time believing AI will take over this Shit.
- No location available
-


dg-publish: true
created: 2024-07-01
modified: 2024-07-01
title: R/Dataengineering - Comment by U/mRWafflesFTW on ”Is Data at Every Company Still an Absolute Mess?”
source: hypothesis

@tags:: #lit✍/📰️article/highlights
@links::
@ref:: R/Dataengineering - Comment by U/mRWafflesFTW on ”Is Data at Every Company Still an Absolute Mess?”
@author:: reddit.com

=this.file.name

Book cover of "R/Dataengineering - Comment by U/mRWafflesFTW on ”Is Data at Every Company Still an Absolute Mess?”"

Reference

Notes

Quote

It's all shit my dude welcome to the thunder dome. The beauty? Job security. The down side? I hope I get laid off all the time to free me from this horrific nightmare. In reality, every company, even those who tell investors "we're data people", are full of shit and data is just a byproduct. It is exhaust. You're sucking exhaust from the tail pipe of 1970 dodge challenger on cinder blocks in a single car garage.Fix it? In the font end? Are you fucking with me? Why spend a couple thousand dollars to fix it to the left when we can spend a million dollars fixing it after the fact?Everyone is a shit head and everything is awful. The bright side? There's a lot of opportunities to improve conditions.
- No location available
-

Quote

And the joke is that companies also have Data Management departments. Just the same shit, but now it's Managed Shit.As if ownership is the problem. No, it's not.No shit gets reduced by managing it. It will only cost you more because some big consultancy corp is needed to do the maturity assessment (outcome is always a 3 or 4 out of 5) and to do the Data Management framework implementation.And Data Management professionals score big time on the Bullshit-job scale, so they are expensive too.You then have a shitload of shit, but it's managed now. And it is expensive so upper management is happy.Those Data Managers and Data Owners, they then think they need to map the data. So that they have oversight of data they have never seen and don't have any clue of.So they use tools to draw boxes and lines, and more boxes and lines. They map all the data in fancy tools, expensive tools. And they say that stuff is getting too complicated because tere are so many boxes and lines. So we need more Data Managers.At the same time, we hire super cheap data engineers, that produce even more shit, because they lack knowledge and proper schooling. And that freshly produced Shit needs even more Ownership and Management.It is like a complete nightmare. It never stops. And I have a hard time believing AI will take over this Shit.
- No location available
-