How to get started with drop to Kibana?
Kibana Elasticsearch is a high-performance analytics and data visualization tool and octave.io provides an off-the-peg access.
Here’s how to start exploring your data with “Drop to Kibana” Feature and be able to explore any large volume of data through a browser-based interface.
In this article, we will walk you through everything you need to know in order to start exploring your data with octave.io: Perform google style searches on practically any type of data, from text documents to machine logs, application metrics, e-commerce traffic, sensor telemetry, or your company’s business KPIs, create useful visualizations using various chart types, and play around with the visualizations using real-time dashboards.
Let’s see how to make it true in 3 steps with Drop to Kibana:2020/09/15 | Drop to Kibana
STEP 1: Adding data to drop to Kibana
As usual, all begins with data: The basic first thing is you need to import data to work with Kibana. And the good news: Drop to Kibana makes it easier than Drag’n Drop.
First: Upload your data in your octave.io secured and private account
When you connect to your octave.io secured account or create one for free, you have already succeeded a lot of hard steps that require lots coding skills. You have a full scalable Elasticsearch Kibana stack embedded: it’s set up and ready to use, with secure and private access. The technical side is on our own, here you interact with a simple file manager as simple as your classical desktop. And Drag’n Drop is a reality: you just need to select the flat files like csv or excel format and that’s it… Your data are ready for preparation and import into Elasticsearch Kibana.
Secondly: Prepare and import data into the ELK stack:
Because it’s a tricky topic which usually requires technical know-how, we make it no-code through the drop to kibana solution. The feature takes in charge your file with preparation and injection into Elasticsearch Kibana stack. The only thing you need to do is to select the data you want to process, mention how you want to name the index in Elasticsearch and let the magic happens: Drop to kibana makes the job and creates an index fulfilled with you data.
At this step, you made the hardest work for anyone: success a complete data importation into Elasticsearch Kibana with all your data type correctly mapped. The data are recognized, as the gelocation or any type of data like number, text…
That’s what we call to unlock the doors of ELK: octave.io gives you the power to push your own data by yourself in this great open source tool.
How possible? We keep it for next article, but keep in mind that’s our art of data: use the techs to ease life and get results! 😉
STEP 2: Create an index pattern in Kibana
Elasticsearch stores data in indices: that’s the results you get when you use drop to Kibana. — Your index is ready and it’s quite similar to tables if you’re familiar with relational databases. Of course, we like to ease but you probably like freedom too: that’s why you have to tell Kibana which Elasticsearch indices you want to explore and how you want to process it regarding time and date data type : This precise action is to create an index pattern and it’s simple because it’s no code.
Through your octave.io account, you access to your private ELK environment and open Management> Kibana>Index pattern menu (see 1 on figure below)
Then, you select the index you want through its name (remember, you mentioned it at previous step). If you have time or date data type, you can choose to use them as time filter. It’s not a requirement, meaning that you can create an index pattern even if your index doesn’t contain no such type of data and you can too decide to discard this option if you have date or time data.(2)
That’s up to you but we can advise to select the option if your indice contains date because it’s very powerfull for the next steps to explore the information in Kibana
And now, it’s done, your index pattern is created, and you check that’s all you data are correctly mapped (3).
Everything is ready to explore your data with kibana browser-based interface.
STEP 3: Navigating in Kibana
We focus on Discover, Visualize, and Dashboard which are the 3 features available through left-hand menu in Kibana to find insights on your data.
Discover is where you can search and filter your raw documents.
Each record is a line you can expand to see all the fields in each record and their values. On the left side, you’ll see a side menu that lists everything fields: you can get statistical insights on data within one click.
In Discover, you can both have an overview of all your data as well as find a needle in a haystack. The time filter allows to zoom on date range and display the concerned data dynamically.
If you look for precise information, it’s as simple as google searches: Mention a word or phrase in the filter bar on top and Kibana will return the specific records you search.
User-friendly functions allow to make some precise queries without coding any language.
The must: it’s incredibly powerful. Filter one raw hidden in billions of records in less than a second is not a problem: we provide the reliable framework to make Elasticsearch Kibana works perfectly and we scale as you perform.
A picture is worth a thousand words: Visualize helps to convey accurate and precise insights based on dynamic data visualizations.
Kibana provides a great offer of pre-built chart types: You can pick a model and design everything with simple clicks.The hardest is to choose the suitable chart type to convince your audience and make your story impactful.
If you have geolocation data, you can design a map very quickly and be able to zoom on precise area to answer any questions.
Remember your chart are dynamic and you can select a range time or a full text search at any time : your chart will be updated in real-time to your search and give the focused and accurate insight like our example below with zoom on US – New York
Metric: It’s the dimension you want to display for the data aggregation you select. By default, it’s always a count of all the records you select from your current filter, time as well as query or full text filter. You can choose a large variety of metrics like sum, average, Min, Max, unique count and also most complex statistical notion if you master them…
The second on is the Bucket aggregation notion.
Bucket: It’s a standard way to display your data following an aggregation based on your fields and built automatically in real-time by Elasticsearch Kibana. In next examples, we first select a date histogram on the x-axis to generate a time serie.
Then, we add a second bucket based on the terms in the field called Df_Etatdesstations to have a more accurate insight. Simple and Great!
Now you can create data visualizations: Mind to save your charts so you can retrieve them and add your creation to an interactive dashboard
Dashboard is usually the most impactful way to convince your audience: it’s alive, real-time and with multiple insights. You can interact with all the data visualizations you created in through a browser-based interface: searches in google way, time filter, query… everything is at your reach.
The good news: Create dashboard is amazingly simple. When you select the dashboard menu in Kibana, you just add the charts you saved. You can adjust all the visualizations in size and appearance like color, details and customize the dashboard by drag’n drop to get the best display.
It’s powerful: if you select a slice in a pie for example or phrase in word tag cloud chart as instance, all the panel of your dashboard will be updated on a fresh view based on your selections.
Now you know the basics of drop to Kibana: you can easily import your data to make analysis, create various visualizations and add them into a dashboard to share insights from your data.
To try it out yourself, the easiest way is to get started with octave.io through our freemium offer which includes drop to kibana features.
We provides great tutorials including a step by step webinar on drop to Kibana where you get all tips from raw data to dashboard : It makes it true in less than an hour.