Enterprise DevOps, Log Management and Analytics

Sematext Blog

Subscribe to Sematext Blog: eMailAlertsEmail Alerts
Get Sematext Blog: homepageHomepage mobileMobile rssRSS facebookFacebook twitterTwitter linkedinLinkedIn

Latest Blogs from Sematext Blog
Docker changed not only how applications are deployed, it also changed the workflow for log management. Instead of writing logs to files, containers write logs to the console (stdout/stderr) and Docker Logging Drivers forward logs to their destination. A check […]
Kubernetes is a really hot topic at the moment. All major cloud providers adopted it as a solution for deploying cloud native apps. Just a few weeks ago, AWS at reInvent introduced EKS (Amazon Elastic Container Service for Kubernetes) which […]
With the release of Solr 7 the community around it produced yet another great version of this search engine. As usual, there is an extensive list of changes, bug fixes and improvements that were introduced in version 7. Just to […]
This is a guest post from Filippo Balicchia. Filippo contributed Logagent plugins for Apache Kafka the details of which he is sharing in this post.  Filippo is a software engineer and a passionate coder interested in distributed and cloud technologies, […]
Another Lucene/Solr Revolution happened on September 12-15, 2017 in Las Vegas. Sematext was there, exhibiting AND giving two talks! Thanks to everyone who stopped by our booth and attended our two talks: Optimize Is (Not) Bad for You by Rafal Kuc Solr on Docker – the Good, the [&...
Another Lucene/Solr Revolution happened on September 12-15, 2017 in Las Vegas. Sematext was there, exhibiting AND giving two talks! Thanks to everyone who stopped by our booth and attended our two talks: Optimize Is (Not) Bad for You by Rafal Kuc Solr on Docker – the Good, the [&...
Elasticsearch is already quite popular and its popularity just keeps growing. Looking at Google Trends chart for the last 5 years shows this nicely: There are a number of reasons why Elasticsearch is popular:  it is very easy to get […]
TL;DR: The main question here is: How Does Java 9 Work with Elasticsearch 6? It works well, but don’t expect miracles. Unless you’re using G1, then there are some miracles. With Java 9 fresh out of the oven and Elasticsearch 6 […]
Do you know what portion of your traffic comes from bots? Do you know which bots are good and which ones are bad? Do you know what the bad bots are up to? We all know Googlebot and consider it […]
Solr vs. Elasticsearch. Elasticsearch vs. Solr.  Which one is better? How are they different? Which one should you use? Before we start, check out two useful Cheat Sheets to guide you through both Solr and Elasticsearch and help boost your productivity and […]
While some are hallucinating about building walls, we at Sematext are looking to knock them down. One of the Sematext differentiators is that it’s not just a monitoring solution or just log management solution.  Sematext provides monitoring AND log management […]
Logsene, our hosted ELK stack now part of Sematext Cloud, exposes the Elasticsearch API. As a Logsene user you may or may not be aware of this.  If you have experience with Elasticsearch though, if you’re aware of its rich […]
Every modern organization depends on software, and where there is software there are metrics and logs and, one would hope, monitoring of these two critically important types of data. Operations teams have traditionally used two separate sets of tools – […]
People love Splunk. But not its price. So people are always on a lookout for a good Splunk alternative. Many of those people migrated from Splunk to ELK Stack or Hosted ELK Stack solutions like Logsene. The situation with Elastic […]
Note: This is a guest post by Jochen Kressin, the CTO of floragunn GmbH, the makers of Search Guard, an open-source X-Pack Security alternative. Elasticsearch is a great piece of software. We really love it. However, there is one major drawback: […]
Note: This is a guest post by Jochen Kressin, the CTO of floragunn GmbH, the makers of Search Guard, an open-source X-Pack Security alternative. In this article, we show you how to secure Elasticsearch and Kibana for free using the Community […]
Over the last several months we’ve made all kinds of improvements to Sematext Docker Agent (SDA).  If you’re not familiar with SDA yet, here it is in a nutshell Sematext Docker Agent is a modern, open-source, Docker-native monitoring and log […]
We are all used to the Solr API that has been present in Solr from its beginnings. We send the data using HTTP protocol, we include all parameters in the URL itself, and we are bound to that. Some people […]
Being able to see the context of a specific log message is one of those highly sought out  features in Kibana that still seems to be missing (though we can see the light at the end of that long tunnel […]
Up until now, Sematext Cloud users had to first provide their credit card details under their account and then manually assign that credit card to each monitoring or logging App they wanted to use with a paid plan.  It turns […]
Need to have your recent logs searchable for your DevOps team(s) to troubleshoot issues, but also need to archive old logs for compliance reasons?   Many organizations need that and Sematext Cloud makes that simple.  You can certainly simply pick […]
Want to ship logs and other events from your iOS apps?   We’ve open-sourced the iOS SDK for shipping logs from iOS apps to Sematext Cloud.  This library not only lets you send your iOS app logs for troubleshooting purposes, […]
A few months back we’ve silently built and open-sourced an Android SDK for shipping logs from mobile apps to Sematext Cloud.  This library not only lets you send your Android app logs for troubleshooting purposes, but it also let’s you […]
We’ve refreshed not only the Sematext Cloud UI, but also our backend, or one of them at least. Last week, we’ve updated Elasticsearch to the latest 5.x version.  Along with it we’ve updated the integrated version of Kibana to which […]
Need we say more?  If you’ve used Sematext Cloud recently you’ve noticed the UI looks and behaves differently.  Indeed, we rewrote the whoooooole front-end using modern front-end technologies like React.js and Redux (watch this statement become outdated in 12 months!). […]
Besides completely revamping the Sematext Cloud user interface recently (hello ReactJS & Redux!), we’ve also made some changes to how certain features work. One of them is related to Alert Rules and related Notification Hooks (aka Integrations). Previously, Alert Rules […]
This post shows how to use Docker Secrets in Docker Swarm mode. For our example we’ll show how to use Docker Secrets to encrypt and safely store tokens used by Sematext Docker Agent for shipping Docker metrics and logs. Containerized […]
On March 29-30, Cloud NativeCon + KubeCon – Berlin, Germany brings together almost 1500 developers, architects, technical leaders, CIOs, CTOs, and analysts from open source cloud native communities – all under a single roof. Come and learn about Fluentd, Kubernetes, […]
Sematext Solr AutoComplete is an open-source Solr add-on that provides suggest-as-you-type functionality. In this post we’ll explain how you can install it, load the autocomplete collection/core with suggestions and how to run queries to get those suggestions back. Why Sematext [...
In the world of DevOps, metric collection, log centralization and analysis Apache Kafka is the most commonly used middleware.  More specifically, it is used as a fast, persistent queue between data sources like log shippers and the storage that makes […]
Since we work with Elasticsearch and Solr on a daily basis and know so much about them we like helping others improve their knowledge of these technologies, not only through Solr & Elastic Stack trainings, but also by sharing our […]
Intrusion detection systems generate highly valuable logs with network usage details and alerts. They collect vast amounts of data and typically store them in structures with a large number of fields.  To make sense of so much data and to […]
As you know, in Sematext we looooove logs and metrics and we enjoy playing with them on a daily basis. We have our Logsene, which is all about logs and their analysis. We have our SPM which can monitor half […]
When dealing with log centralization in your organization you have to start with something. Often times people start by collecting logs for the most crucial pieces of software, and frequently one chooses to ship them to their own in-house Elasticsearch-based solution (aka ELK stack) or...
Pretty much everyone’s heard about syslog: with its roots in the 80s, it’s still used for a lot of the logging done today. Mostly because of its long history, syslog is quite a vague concept, referring to many things. Which is why you’ve probably heard: Check syslog, ...
Enterprises without DevOps teams and culture typically experience long applications deployment cycles. Once developers make a new release the operations team needs to deploy it to one of the existing or new servers, and it often takes a long time (up to several weeks is not uncommon) t...
The recent ransom attack on public Elasticsearch instances showed that Elasticsearch security is still a hot topic. Elasticsearch was not the only target – tens of thousands of poorly configured MongoDB databases have been compromised over the past week, too, compromising over 27...
One way to create a better search experience is to understand the user intent.  One of the phases in that process is query understanding, and one simple step in that direction is query segmentation. In this post, we’ll cover what query segmentation is and when it is useful. We will als...
2017 is almost here and, like last year, we thought we’d share how 2016 went for us.  We remain committed to be your “one-stop shop” for all things Elasticsearch and Solr: from Consulting, Production Support, and Training, to complementing that with our Logsene for all your logs, and S...
Nowadays there are more and more organizations searching for fault-tolerant and highly available solutions for various parts of their infrastructure, including search, which evolved from merely a “nice to have” feature to the first class citizen and a “must have”...