How to Scale End-to-End Observability in AWS Environments

What is Grafana?

in Monitoring and Observability

What is grafana .jpg

Today, almost every application stack would usually consist of a number of different applications, each performing a specific role and working together towards a common goal. This is the case whether it be that of a fortune 500 company or a computer science student trying to complete a tech project.


    What is Grafana - Overview

    Today, almost every application stack would usually consist of a number of different applications, each performing a specific role and working together towards a common goal. This is the case whether it be that of a fortune 500 company or a computer science student trying to complete a tech project.

    As such, the stability and reliability of your infrastructure would greatly depend on the performance of each application within that infrastructure.

    Understanding the state of these applications is vital to keeping your systems in the best shape possible. This is done by monitoring our applications, in other words, collecting data (usually in the form of time series data) about these applications that would inform you of their current state at all times.

    The larger your stack, the more applications you need to monitor to ensure your infrastructure is healthy. This would lead to collecting large amounts of performance data on your application. You would then require a massive amount of effort to parse through and make sense out of this data, which is not a pretty task without the right tool.

    Grafana was made exactly for this purpose!

    Grafana is an open source analytics and interactive visualization web application. It allows you to ingest data from a huge number of data sources, query this data and display it on beautiful customizable charts for easy analysis.

    It is also possible to set alerts so you can quickly and easily be notified of abnormal behavior and lots more. In simple terms, Grafana allows you to transform the mountain of performance metric data collected from your applications, into visualizations. This will allow you to draw conclusions and take decisions to keep your application stack healthy.

    By utilizing performance metric data, MetricFire specializes in monitoring systems by using both Graphite and Grafana. You can use our product with minimal configuration to gain in-depth insight into your environments. If you would like to learn more about it please book a demo with us, or sign on to the free trial today.

    What is Grafana - Its features

    Grafana comes with a plethora of features that provide value straight out of the box. These features are the reason Grafana is arguably one of the most popular visualization software available for metric monitoring, simply because of their ease of use:

    1. Visualization

    Grafana possesses a huge variety of visualization options to help you view and understand your data easily. These options are split into “panels” which are then used to build the Grafana dashboard.

    A panel is the most granular visualization building block in Grafana, and is used to display data that has been queried from the data source attributed to that panel. For easier understanding, think of a panel as a space on the dashboard that houses a specific type of visual portrait of information.

    This information is being pulled from the data source attributed to that panel and can be a type of graph (gauge, histogram, bar chart, etc.), or logs and alerts. For example, one could create a gauge panel with its data source set to Prometheus, then query CPU usage data stored in Prometheus to be displayed on this panel. Such a panel would look like this:

    Node explorer.png

    You could stack up panels like this to make up a dashboard, with each panel displaying its own piece of information in the manner that best suits you. Worthy of note is the fact that although Grafana ships with some pretty cool panels, you could design and add your own panels using plugins - the power of Open Source.

    Check out these MetricFire articles (Grafana plugins and Grafana plugins explained) on how to set up Grafana plugins. For a more in-depth look into Grafana dashboards, look no further than this MetricFire article.

    2. Alerting

    When monitoring applications, it is essential to be made aware the second something goes wrong, or is abnormal. This is vital to keeping your systems healthy, and reducing down time. Grafana has in built-in support for a huge number of notification channels, be it email, Slack, PagerDuty, etc., which ever best suits you.

    In order to create an alert, you’d have to create and configure an alert rule. This rule serves as a trigger for your alert, such that whenever said rule is broken, an alert notification is sent via the alert notification channel you had configured into the rule. For a more detailed look into Grafana alerts, look no further than this MetricFire article - Grafana alerting.

    3. Annotations

    Grafana allows you to annotate, or in simple terms, leave notes directly on graphs. This simple but powerful feature provides a way to seamlessly mark important points on your graph. This serves as a reminder for further action in future, to provide context to an onboarding team member, or to simply mark a special event on your graph.

    Think of it as writing a sticky note and placing it directly on your graph, but this time, you don’t need any sticky note papers. Further information on annotations can be found in our Grafana annotations tutorial article (yes, we have articles for everything Grafana!).

    4. Open Source

    Grafana is completely open source and backed by an active vibrant community. This presents some huge benefits to its users such as the flexibility to develop and publish their own plugins or use plugins developed by other people. These plugins are usually easy to install by pretty much downloading the source code and running it manually.

    However, its open source nature does pave the way for some drawbacks. For example, you would have to manually maintain your Grafana instance yourself, manually perform updates and so on. These drawbacks are completely handled by MetricFire’s Hosted Grafana offering, which provides all the functionality Grafana has to offer, with none of the management overhead.

    Book a free trial today or call for a demo with our team to try it out.

    What is Grafana - Datasources

    Grafana is a tool used to analyze and visualize data. But this data would have to be stored somewhere in order for Grafana to access and display it. These databases are what we refer to as datasources, and a Grafana datasource is simply any database from which it can pull data.

    All you have to do is create a connection between your Grafana instance and that datasource, and provide a data query. Grafana would then pull and display data from this datasource at predefined/configurable intervals based on the query provided. Each datasource supported by Grafana has a specific query editor for an optimal query writing experience.

    It can be customized for the capabilities and features peculiar to that datasource, with some of these editors having an autocomplete feature. You could also display data from multiple data sources on a single dashboard. This can be achieved by a couple of ways.

    First, by separating out the datasources such that each panel in the dashboard displays data from a separate data source. Second, using a special “mixed” datasource, which allows you to combine data from multiple datasources on to a single panel.

    Due to its open source nature, Grafana has native support for a massive number of databases. However, if your database is not supported by Grafana at this moment, you can write up a plugin through which your database would interact with Grafana. It would then work the same as though it had native support for that database.

    For this reason it's highly likely that you would be able to export your data to Grafana, no matter where it's stored.

    What is Hosted Grafana by MetricFire?

    MetricFire provides a managed Grafana, offering users to directly use Grafana as a cloud hosted web app without the need to install or set up Grafana locally. This offering is completely maintained and upgraded by MetricFire and would take away the manual update and maintenance cycles that would be traditional for normal open source applications. Therefore leaving you to focus solely on monitoring your system.

    Sign up for a free trial today to take our Hosted Grafana for a spin, or schedule a demo to speak to one of our experts to help you get started.


    Get similar stories in your inbox weekly, for free



    Share this story:
    metricfire
    MetricFire

    MetricFire provides a complete infrastructure and application monitoring platform from a suite of open source monitoring tools. Depending on your setup, choose Hosted Prometheus or Graphite and view your metrics on beautiful Grafana dashboards in real-time.

    How to Scale End-to-End Observability in AWS Environments

    Latest stories


    How ManageEngine Applications Manager Can Help Overcome Challenges In Kubernetes Monitoring

    We tested ManageEngine Applications Manager to monitor different Kubernetes clusters. This post shares our review …

    AIOps with Site24x7: Maximizing Efficiency at an Affordable Cost

    In this post we'll dive deep into integrating AIOps in your business suing Site24x7 to …

    A Review of Zoho ManageEngine

    Zoho Corp., formerly known as AdventNet Inc., has established itself as a major player in …

    Should I learn Java in 2023? A Practical Guide

    Java is one of the most widely used programming languages in the world. It has …

    The fastest way to ramp up on DevOps

    You probably have been thinking of moving to DevOps or learning DevOps as a beginner. …

    Why You Need a Blockchain Node Provider

    In this article, we briefly cover the concept of blockchain nodes provider and explain why …

    Top 5 Virtual desktop Provides in 2022

    Here are the top 5 virtual desktop providers who offer a range of benefits such …

    Why Your Business Should Connect Directly To Your Cloud

    Today, companies make the most use of cloud technology regardless of their size and sector. …

    7 Must-Watch DevSecOps Videos

    Security is a crucial part of application development and DevSecOps makes it easy and continuous.The …