Certify Your Data Assets to Avoid Treating Your Data Engineers Like Catalogsby@barrmoses
849 reads
849 reads

Certify Your Data Assets to Avoid Treating Your Data Engineers Like Catalogs

by Barr Moses10mJune 15th, 2022
Read on Terminal Reader
Read this story w/o Javascript
tldt arrow

Too Long; Didn't Read

Say it with me: data engineers are not a data catalog. You would be hard pressed to find “answering multiple Slack messages every week about which tables are good to use for this report,” in their job description, but it happens nonetheless. Data analysts aren’t psychic. Yet, they are often placed in the position of having to intuit if the data being piped is trustworthy. Data certification can help. Here's how it works. Step 1: Build out your data observability capabilities Step 2: Determine your data owners Step 3: Understand what "good" data looks like Step 4: Set clear SLAs for your most important data sets Step 5: Develop your communication and incident management processes Step 6: Determine a mechanism to tag the data as certified Step 7: Train your data team and downstream consumers

People Mentioned

Mention Thumbnail

Companies Mentioned

Mention Thumbnail
Mention Thumbnail
featured image - Certify Your Data Assets to Avoid Treating Your Data Engineers Like Catalogs
Barr Moses HackerNoon profile picture
Barr Moses

Barr Moses

@barrmoses

CEO and co-founder of Monte Carlo. Proponent of data reliability and action movies.

About @barrmoses
LEARN MORE ABOUT @BARRMOSES'S
EXPERTISE AND PLACE ON THE INTERNET.

Share Your Thoughts

About Author

Barr Moses HackerNoon profile picture
Barr Moses@barrmoses
CEO and co-founder of Monte Carlo. Proponent of data reliability and action movies.

TOPICS

THIS ARTICLE WAS FEATURED IN...

Permanent on Arweave
Read on Terminal Reader
Read this story in a terminal
 Terminal
Read this story w/o Javascript
Read this story w/o Javascript
 Lite
L O A D I N G
. . . comments & more!