Install Logstash 5.0 in Linux In this article I will cover installation of the Logstash 5.0 in Linux and basic configuration apart from it I will cover validation of Logstash configuration. How Can we start and stop Logstash and verifying that everything is running properly Let’s start with What is Logstash? What is Logstash? Logstash…
Simple bash Script to get the list of files and directories inside the specified path Sometimes we want to get the list of files and directories recursively, but it is tedious to navigate each directory to check all the files. Here are the simple commands which will help you to check all the files and…
What are the slow log settings in Elasticsearch? Elasticsearch provide facility to keep track of your slow queries while indexing and searching data. It helps us to identify the slow elasticsearch query. You can configure slow log threshold according to your requirement. Its just depends on your architecture. Sometimes 2s query are fine for us…
In HTML5 Void element doesn’t require closing tags. What are the Void Elements? A Void element is an element that can not allow to have any content in between the start and closing tags. Void elements only have a start tag; end tags must not be specified for void elements. Void elements: area, base, br,…
Partial Update in Elasticsearch Partial update in elasticsearch works same as updating whole document in Elasticsearch. This process retrieve the document, change it and reindex it again. In elasticsearch partial update is done through Update API. Update API also support scripting language to update a document. We can write our own logic in script like…
Documents in Elasticsearch are always immutable we cannot replace or change them directly. If we require updating document in Elasticsearch then we need to reindex or replace it. We can change an existing document by using Index API as well. Elasticsearch delete the old document automatically and add a new document internally. Updating Document in…
How to increase or decrease replica in Elasticsearch You can change number of replicas in live Elasticsearch Cluster using Indices APIs update indices settings. Update number of replicas for all indices: curl -XPUT ‘localhost:9200/_settings’ -d ‘ { “index” : { “number_of_replicas” : 2 } }’ Update number of replicas for a single index or multiple…
How to add new node in elasticsearch cluster? Here is step by step guideline to add new node in existing elasticsearch cluster. 1) Elasticsearch Installation: Install elasticsearch in new node. Elasticsearch version should be same as existing cluster nodes. If you are not aware then you may refer my these guideline Install Elasticsearch 5.0 on…
You might get this problem with fielddata size limit. fielddata size limit is checked after the query data is loaded. When your elasticsearch query tried to load data more than the fielddata available memory then you would get the OutOfMemoryException. Caused by: org.elasticsearch.common.breaker.CircuitBreakingException: Data too large, data for field [parent/child id cache] would be larger…
Get file MIME type in Python You can get file mime type in python by using python-magic library. You can install python-magic using PIP. $ pip install python-magic To find mime type, import magic library and pass file path into magic.from_file() >>> import magic >>> magic.from_file(“path/to/file.pdf”, mime=True) ‘application/pdf’ If you face error “AttributeError: ‘module’ object…
