You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am introducing Dagster OSS into our data platform infrastructure as the main orchestrator.
Unfortunately, due to company restrictions, we are not allowed to use Dagit for UI access in Production (but we have it in lower environments). Given this, I’m wondering what my options are for visibility.
We currently use Splunk and New Relic for monitoring, so I wanted to explore the possibility of sending Dagster logs and metrics to these platforms for visibility. Additionally, I’m looking to ensure everything is controlled and orchestrated via scheduled pipelines without needing direct UI access.
Are there any best practices for integrating Dagster logs with these tools, and is it feasible to automate monitoring and alerting from these platforms for Dagster’s operation?
The obvious operations that I am interested in are:
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Hi,
I am introducing Dagster OSS into our data platform infrastructure as the main orchestrator.
Unfortunately, due to company restrictions, we are not allowed to use Dagit for UI access in Production (but we have it in lower environments). Given this, I’m wondering what my options are for visibility.
We currently use Splunk and New Relic for monitoring, so I wanted to explore the possibility of sending Dagster logs and metrics to these platforms for visibility. Additionally, I’m looking to ensure everything is controlled and orchestrated via scheduled pipelines without needing direct UI access.
Are there any best practices for integrating Dagster logs with these tools, and is it feasible to automate monitoring and alerting from these platforms for Dagster’s operation?
The obvious operations that I am interested in are:
Thank you!
Beta Was this translation helpful? Give feedback.
All reactions