CloudWatch vs. Alternatives

Do you wish you could use CloudWatch, but don't want to go all-in on AWS products? There's AWS Lambda, EKS, ECS, CloudWatch and more. How much does that all cost in the end? Why do companies choose AWS when there's so many options out there? In this blog post we're going to look at what alternatives small and medium business have to CloudWatch, and what each of these services can and can't do.

MetricFire is a time-series metrics monitoring platform built on the open source Prometheus, Graphite, and Grafana. We have an AWS add-on that lets you pipe AWS metrics directly into our Grafana dashboards, so you can see your AWS-specific metrics correlated directly with app metrics. Try the MetricFire free trial here, and get started in minutes. 

List of tools we will compare:

• CloudWatch
• MetricFire
• Datadog
• Dynatrace
• Prometheus (Open-Source)
• Graphite (Open-Source)

‍

CloudWatch

Pros:

• It allows us to configure alarms to trigger a notification (like sending emails) when any specified condition is rendered satisfied.
• CloudWatch provides the feature called Events, which is different from alerts. It makes the platform aware of the application’s operational changes as they happen in real-time. An Event can even automatically trigger a specified action.
• Very advanced visibility and insights about other integrated AWS services.
• Only pay for what you use.
• Centralized storage and analysis for logs and metrics from all combined AWS resources and also allows executing queries on this data.

Cons:

• It can only be used for AWS services. There may be some good scripts made by third parties to get metrics for non-AWS servers but they aren't an "official" solution.
• Not enough customization of dashboards.
• No transaction tracing.
• No metrics for memory usage by default. A custom metric has to be configured in order to have this basic indicator monitored.
• Becomes very expensive at the enterprise level - can be over $50,000 per year.

MetricFire

MetricFire provides the users with a bundled eco-system for end-to-end infrastructure monitoring consisting of the three most popular open-source monitoring services i.e. Grafana, Graphite and Prometheus, all in a hosted environment, and all in the same product. But that’s just not it! MetricFire boosts these services in their hosted environments with their own custom features, which renders the service more functional than original open source projects.

For example, MetricFire improves upon vanilla Graphite by adding key components such as a built-in agent, team accounts, granular dashboard permissions, better data aggregation, and integrations to other technologies and services like AWS, Heroku, logging tools and more. Setting up your infrastructure monitoring with Graphite has never been easier. Sign up for a free trial and get started sending metrics to MetricFire.

What makes MetricFire a competitor:

Pros of Grafana as a Service over self-hosted Grafana:

1. Hundreds of pre-built dashboards tailored to each plugin.
2. Easy facilitation of alerting to the customer's notification channel of choice.
3. Included with all the plans offered by MetricFire, regardless of the size.
4. No need to set up your own servers or data storage centers, it's all done for you in MetricFire.

Pros of hosted graphite over open-source Graphite:

1. Redundant storage up to 3 times - MetricFire has replaced Graphite’s antiquated file-based whisper storage for cluster-based storage for seamless scaling with multiple redundant copies of the user’s data.
2. Increased support for tagged metrics - The ecosystem smoothly supports storing and categorization of data using tags.
3. Built in API endpoints - Everything MetricFire offers is built to be automated with their APIs.
4. Automatic backups for user data every hour.
5. First line defence provided by quality engineers and developers coupled with 24/7 on call support.
6. Designed for teams of every size, from startups to large scale enterprises.
7. 7+ years of experience in Graphite monitoring, which guarantees a matured platform with stability.
8. No additional dependencies required for installation.

Pros of Hosted Prometheus over open-source Prometheus:

1. 3x redundancy for all user data in the backend for high fault-tolerance.
2. Stable updates with regular new features.
3. Downsized samples support 5 minute and 1 hour intervals.

Dynatrace

Pros:

• Fairly easy installation process.
• The free version allows up to 5 servers to be monitored for an unlimited time, however the free version doesn't include data retention. The number of visits is capped at 100k.
• Detects your deployed app’s topology and environmental changes in absolute real-time.
• Very smart at transaction tracing and process tracing.
• Your entire application topology is visualized in an interactive infographic.

Cons:

• The interface seems a bit too complex, especially for users with no experience using cloud monitoring tools.
• For small and immediate deployment infrastructures, the free version is really good. But for production level operations, Dynatrace doesn't provide information about pricing on the site.

‍

DataDog

Pros:

1. Well-integrated infrastructure monitoring provides a well-balanced user experience.
2. Easy one-line installation: with a quick installation (which is mostly automated) users can possess the option to easily deploy their instance across any/every host in their infrastructure.
3. Auto-instrumentation for frameworks: Datadog is designed to intelligently trace requests (incoming/outgoing) from/to popular libraries, their extensions and/or frameworks.
4. Extensive customization: users can employ the API and DataDog’s existing open-source agent to collect custom information.
5. Very wide coverage area: the distributed tracing capability and the platform easily supports many languages and they're actively testing even more in beta.
6. Robust alerting: Datadog allows heavily customizable alerts with the capacity to apply custom functions to users' metrics and to target specific groups of resources by using straightforward tags.

Cons:

1. Might take beginners in the field a bit of time to get familiar with the UI. Although the user interface is fairly nice on the first impression, it can be fairly technical to use.
2. With too many applications and integrations, it can be a bit confusing to find the right dashboard.
3. Datadog is a very mature product, but features still seem limited and the UI is very plain.

Prometheus

Pros

1. Open-source
2. Provides a one-stop metric monitoring, analyzing and querying solution.
3. Works very well for recording and storing numeric time series.
4. Provides extensive support for multi-dimensional data collection.
5. Allows us to fine-tune the amount of RAM by requirement.
6. Provides special-purpose exporters for external services and integrations like StatsD, Graphite, and HAProxy.
7. Extensive support to third-party clients and libraries.

Cons

1. Fails to provide 100% accuracy in terms of data being collected, refined and ultimately presented.
2. It is advised to use a different mechanism for billing, and employ Prometheus just for monitoring purposes.
3. Data is sometimes incomplete or insufficient.

Open-Source Graphite

Pros

1. Stores information in PostgreSQL or MySQL Databases, and can work with other DBs as well.
2. Uses plugins to collect metrics, for example StatsD or Collectd.
3. Neat UI for querying and visualization.
4. Render graphs of the collected data on demand.
5. Easy third-party integrations.

Cons

1. Problematic under larger loads and might require careful planning in terms of CPU and disk capacity.  
2. Many challenges at the time of scaling since it only handles metrics storage with rendering and doesn't record the metrics. You might need to employ other tools for recording metrics into storage.
3. Not the best UI when compared to competitors like Grafana Labs.

Conclusion

CloudWatch is the most appropriate option if your stack is largely AWS. AWS services are expensive compared to competitors, but it is recommend for very large high-profile companies. Otherwise, choosing a monitoring tool will depend on the use-case it's needed for. Each tool can be leveraged depending on its audience, pricing and ultimate application.

Get onto the MetricFire free trial today and start monitoring immediately. If you're interested in finding out how MetricFire can help with your monitoring needs, book a demo and talk to us directly.