tag:blogger.com,1999:blog-41084976461267195632024-03-13T11:50:21.054-07:00Belajar Bareng Elastic SearchSearch & Analyze Data in Real TimeWildan Maulanahttp://www.blogger.com/profile/03271713878662854306noreply@blogger.comBlogger13125tag:blogger.com,1999:blog-4108497646126719563.post-76459042148009670412017-04-17T07:46:00.003-07:002021-01-08T06:51:22.629-08:00Deteksi Plagiasi Karya Tulis Menggunakan ElasticSearch<b>Status : Draft</b><br />
<b><br /></b>
<h3>
Referensi</h3>
<ol>
<li>Duplicate documents detection in Elasticsearch, <a href="https://discuss.elastic.co/t/duplicate-documents-detection-in-elasticsearch/37987" target="_blank">https://discuss.elastic.co/t/duplicate-documents-detection-in-elasticsearch/37987</a></li><li>Similarity module, <a href="https://www.elastic.co/guide/en/elasticsearch/reference/current/index-modules-similarity.html" target="_blank">https://www.elastic.co/guide/en/elasticsearch/reference/current/index-modules-similarity.html</a></li><li>Understanding Similarity Scoring in Elasticsearch, <a href="https://www.infoq.com/articles/similarity-scoring-elasticsearch/" target="_blank">https://www.infoq.com/articles/similarity-scoring-elasticsearch/</a></li><li>Is there a way to show at what percentage a selected document is similar to others on ElasticSearch?, <a href="https://stackoverflow.com/questions/58904674/is-there-a-way-to-show-at-what-percentage-a-selected-document-is-similar-to-othe" target="_blank">https://stackoverflow.com/questions/58904674/is-there-a-way-to-show-at-what-percentage-a-selected-document-is-similar-to-othe</a></li>
</ol>
Wildan Maulanahttp://www.blogger.com/profile/03271713878662854306noreply@blogger.com0tag:blogger.com,1999:blog-4108497646126719563.post-89898679917694666052017-01-04T00:40:00.001-08:002017-01-04T00:43:45.856-08:00Instalasi X-Pack<b>Status : Draft</b><br />
<b><br /></b>
Versi Elasticsearch yang digunakan : 5.0.0<br />
<b><br /></b>
$sudo ./bin/elasticsearch-plugin install x-pack<br />
> Downloading x-pack from elastic<br />
[=================================================] 100% <br />
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@<br />
@ WARNING: plugin requires additional permissions @<br />
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@<br />
* java.lang.RuntimePermission accessClassInPackage.com.sun.activation.registries<br />
* java.lang.RuntimePermission getClassLoader<br />
* java.lang.RuntimePermission setContextClassLoader<br />
* java.lang.RuntimePermission setFactory<br />
* java.security.SecurityPermission createPolicy.JavaPolicy<br />
* java.security.SecurityPermission getPolicy<br />
* java.security.SecurityPermission putProviderProperty.BC<br />
* java.security.SecurityPermission setPolicy<br />
* java.util.PropertyPermission * read,write<br />
* java.util.PropertyPermission sun.nio.ch.bugLevel write<br />
* javax.net.ssl.SSLPermission setHostnameVerifier<br />
See http://docs.oracle.com/javase/8/docs/technotes/guides/security/permissions.html<br />
for descriptions of what these permissions allow and the associated risks.<br />
<br />
Error diatas dapat diabaikan.<br />
<div>
<br /></div>
<div>
Kibana 5.1.1 tidak mendukung node Elasticsearch v5.0.0</div>
<div>
<br /></div>
<div>
Versi ElasticSearch dan Kibana harus sama. </div>
<div>
<br />
Kibana secara default dapat diakses di alamat : http://localhost:5601/</div>
<div>
<br /></div>
<div>
<h3>
Referensi</h3>
</div>
<div>
<ol>
<li>Install Kibana, <a href="https://www.elastic.co/downloads/kibana" target="_blank">https://www.elastic.co/downloads/kibana</a></li>
<li>Install X-Pack, <a href="https://www.elastic.co/downloads/x-pack" target="_blank">https://www.elastic.co/downloads/x-pack</a></li>
</ol>
</div>
Wildan Maulanahttp://www.blogger.com/profile/03271713878662854306noreply@blogger.com0tag:blogger.com,1999:blog-4108497646126719563.post-9091201095380965252016-12-17T03:46:00.001-08:002017-01-03T22:55:56.373-08:00Software-software pendukung untuk meningkatkan produktifitas ketika bekerja dengan ElasticSearch<b>Status : Draft</b><br />
<b><br /></b>
<br />
<h3>
Referensi</h3>
<ol>
<li>X-Pack, <a href="https://www.elastic.co/products/x-pack" target="_blank">https://www.elastic.co/products/x-pack</a></li>
<li>Elastic HQ, Sleek, intuitive, and powerful ElasticSearch Management and Monitoring., <a href="http://www.elastichq.org/" target="_blank">http://www.elastichq.org/</a></li>
<li>elasticsearch-gui, <a href="https://github.com/jettro/elasticsearch-gui" target="_blank">https://github.com/jettro/elasticsearch-gui</a></li>
<li>Searchkit, UI components for Elasticsearch, <a href="http://searchkit.co/" target="_blank">http://searchkit.co/</a></li>
</ol>
Wildan Maulanahttp://www.blogger.com/profile/03271713878662854306noreply@blogger.com0tag:blogger.com,1999:blog-4108497646126719563.post-71824909331804832612016-11-19T20:35:00.000-08:002016-11-19T20:35:01.871-08:00Autentifikasi di ElasticSearch 5.0<b>Status : Draft</b><br />
<br />
.....<br />
<h3>
Referensi</h3>
<br />
<ol>
<li>How to disable elasticsearch 5.0 authentication?, <a href="http://stackoverflow.com/questions/37508655/how-to-disable-elasticsearch-5-0-authentication">http://stackoverflow.com/questions/37508655/how-to-disable-elasticsearch-5-0-authentication</a></li>
</ol>
<br />
<b><br /></b>Wildan Maulanahttp://www.blogger.com/profile/03271713878662854306noreply@blogger.com0tag:blogger.com,1999:blog-4108497646126719563.post-67178476687353775232016-11-12T00:27:00.002-08:002016-11-12T00:27:49.704-08:0008. ElasticSearch : Sorting and Relevance<center>
<iframe src="//www.slideshare.net/slideshow/embed_code/key/nLmlFRfDyj4Pll" width="595" height="485" frameborder="0" marginwidth="0" marginheight="0" scrolling="no" style="border:1px solid #CCC; border-width:1px; margin-bottom:5px; max-width: 100%;" allowfullscreen> </iframe> <div style="margin-bottom:5px"> <strong> <a href="//www.slideshare.net/openthinklabs/08-elasticsearch-sorting-and-relevance" title="08. ElasticSearch : Sorting and Relevance" target="_blank">08. ElasticSearch : Sorting and Relevance</a> </strong> from <strong><a target="_blank" href="//www.slideshare.net/openthinklabs">OpenThink Labs</a></strong> </div>
</center>Wildan Maulanahttp://www.blogger.com/profile/03271713878662854306noreply@blogger.com0tag:blogger.com,1999:blog-4108497646126719563.post-17438431512118480812016-11-01T22:57:00.002-07:002016-11-01T22:57:28.306-07:0007. ElasticSearch : Full-Body Search<center>
<iframe src="//www.slideshare.net/slideshow/embed_code/key/Bp1rcl7FrwpErS" width="595" height="485" frameborder="0" marginwidth="0" marginheight="0" scrolling="no" style="border:1px solid #CCC; border-width:1px; margin-bottom:5px; max-width: 100%;" allowfullscreen> </iframe> <div style="margin-bottom:5px"> <strong> <a href="//www.slideshare.net/openthinklabs/07-elasticsearch-fullbody-search" title="07. ElasticSearch : Full-Body Search" target="_blank">07. ElasticSearch : Full-Body Search</a> </strong> from <strong><a target="_blank" href="//www.slideshare.net/openthinklabs">OpenThink Labs</a></strong> </div>
</center>Wildan Maulanahttp://www.blogger.com/profile/03271713878662854306noreply@blogger.com0tag:blogger.com,1999:blog-4108497646126719563.post-53113257321812622172016-11-01T21:33:00.001-07:002016-11-01T21:34:06.580-07:0006. ElasticSearch : Mapping and Analysis<center>
<iframe src="//www.slideshare.net/slideshow/embed_code/key/fKLbgE8e5A6M7O" width="595" height="485" frameborder="0" marginwidth="0" marginheight="0" scrolling="no" style="border:1px solid #CCC; border-width:1px; margin-bottom:5px; max-width: 100%;" allowfullscreen> </iframe> <div style="margin-bottom:5px"> <strong> <a href="//www.slideshare.net/openthinklabs/06-elasticsearch-mapping-and-analysis" title="06. ElasticSearch : Mapping and Analysis" target="_blank">06. ElasticSearch : Mapping and Analysis</a> </strong> from <strong><a target="_blank" href="//www.slideshare.net/openthinklabs">OpenThink Labs</a></strong> </div>
</center>Wildan Maulanahttp://www.blogger.com/profile/03271713878662854306noreply@blogger.com0tag:blogger.com,1999:blog-4108497646126719563.post-86079590414813004822016-10-19T01:05:00.000-07:002016-10-19T01:05:10.515-07:0005. Searching – The Basic Tools<center>
<iframe src="//www.slideshare.net/slideshow/embed_code/key/hX4HiOyO9rNyRB" width="595" height="485" frameborder="0" marginwidth="0" marginheight="0" scrolling="no" style="border:1px solid #CCC; border-width:1px; margin-bottom:5px; max-width: 100%;" allowfullscreen> </iframe> <div style="margin-bottom:5px"> <strong> <a href="//www.slideshare.net/openthinklabs/05-searching-the-basic-tools" title="05. Searching – The Basic Tools" target="_blank">05. Searching – The Basic Tools</a> </strong> from <strong><a target="_blank" href="//www.slideshare.net/openthinklabs">OpenThink Labs</a></strong> </div>
</center>
Wildan Maulanahttp://www.blogger.com/profile/03271713878662854306noreply@blogger.com0tag:blogger.com,1999:blog-4108497646126719563.post-29850291856387195472016-10-18T23:52:00.001-07:002016-10-18T23:52:18.564-07:0004. Distributed Document Store<center>
<iframe src="//www.slideshare.net/slideshow/embed_code/key/BouCLrLQ7zJ6LO" width="595" height="485" frameborder="0" marginwidth="0" marginheight="0" scrolling="no" style="border:1px solid #CCC; border-width:1px; margin-bottom:5px; max-width: 100%;" allowfullscreen> </iframe> <div style="margin-bottom:5px"> <strong> <a href="//www.slideshare.net/openthinklabs/04-distributed-document-store" title="04. Distributed Document Store" target="_blank">04. Distributed Document Store</a> </strong> from <strong><a target="_blank" href="//www.slideshare.net/openthinklabs">OpenThink Labs</a></strong> </div>
</center>Wildan Maulanahttp://www.blogger.com/profile/03271713878662854306noreply@blogger.com0tag:blogger.com,1999:blog-4108497646126719563.post-4649077510955337142016-10-05T10:17:00.002-07:002016-10-05T10:17:12.603-07:0003. ElasticSearch : Data In, Data Out<center>
<iframe src="//www.slideshare.net/slideshow/embed_code/key/kHmwxRHPb512qd" width="595" height="485" frameborder="0" marginwidth="0" marginheight="0" scrolling="no" style="border:1px solid #CCC; border-width:1px; margin-bottom:5px; max-width: 100%;" allowfullscreen> </iframe> <div style="margin-bottom:5px"> <strong> <a href="//www.slideshare.net/openthinklabs/03-elasticsearch-data-in-data-out" title="03. ElasticSearch : Data In, Data Out" target="_blank">03. ElasticSearch : Data In, Data Out</a> </strong> from <strong><a href="//www.slideshare.net/openthinklabs" target="_blank">OpenThink Labs</a></strong> </div>
</center>Wildan Maulanahttp://www.blogger.com/profile/03271713878662854306noreply@blogger.com0tag:blogger.com,1999:blog-4108497646126719563.post-14345578462536633282016-10-04T21:19:00.001-07:002016-10-04T21:19:50.098-07:0002. ElasticSearch : Distributed Cluster<center>
<iframe src="//www.slideshare.net/slideshow/embed_code/key/EjRzCseQ7XYUSL" width="595" height="485" frameborder="0" marginwidth="0" marginheight="0" scrolling="no" style="border:1px solid #CCC; border-width:1px; margin-bottom:5px; max-width: 100%;" allowfullscreen> </iframe> <div style="margin-bottom:5px"> <strong> <a href="//www.slideshare.net/openthinklabs/02-elasticsearch-distributed-cluster" title="02. ElasticSearch : Distributed Cluster" target="_blank">02. ElasticSearch : Distributed Cluster</a> </strong> from <strong><a href="//www.slideshare.net/openthinklabs" target="_blank">OpenThink Labs</a></strong> </div>
</center>Wildan Maulanahttp://www.blogger.com/profile/03271713878662854306noreply@blogger.com0tag:blogger.com,1999:blog-4108497646126719563.post-35498876258279282592016-10-04T01:12:00.002-07:002016-10-04T01:12:14.331-07:0001. ElasticSearch : Getting Started<center>
<iframe src="//www.slideshare.net/slideshow/embed_code/key/ekzG41xy9NC3mR" width="595" height="485" frameborder="0" marginwidth="0" marginheight="0" scrolling="no" style="border:1px solid #CCC; border-width:1px; margin-bottom:5px; max-width: 100%;" allowfullscreen> </iframe> <div style="margin-bottom:5px"> <strong> <a href="//www.slideshare.net/openthinklabs/01-elasticsearch-getting-started" title="01 ElasticSearch : Getting Started" target="_blank">01 ElasticSearch : Getting Started</a> </strong> from <strong><a href="//www.slideshare.net/openthinklabs" target="_blank">OpenThink Labs</a></strong> </div>
</center>Wildan Maulanahttp://www.blogger.com/profile/03271713878662854306noreply@blogger.com0tag:blogger.com,1999:blog-4108497646126719563.post-64520277605001857362016-06-07T04:59:00.000-07:002016-06-07T07:39:57.757-07:00Instalasi Elastic Search<div class="separator" style="clear: both; text-align: center;">
</div>
<div class="separator" style="clear: both; text-align: center;">
<a href="https://1.bp.blogspot.com/-bxt0EZJ_XNc/V1bcjDUxH7I/AAAAAAAAFLM/T9bw_pAsxuw7lziafxcgF-OcbmQkJLz6ACLcB/s1600/elastic-search-cluster-798x350.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="175" src="https://1.bp.blogspot.com/-bxt0EZJ_XNc/V1bcjDUxH7I/AAAAAAAAFLM/T9bw_pAsxuw7lziafxcgF-OcbmQkJLz6ACLcB/s400/elastic-search-cluster-798x350.jpg" width="400" /></a></div>
<br />
<br />
<h3>
Sistem Operasi </h3>
<br />
Penulis melakukan instalasi Elastic Search di Ubuntu 16.04 LT menggunakan systemd.<br />
<br />
<h3>
Instalasi Elastic Search </h3>
<br />
Untuk instalasi penulis memilih melakukan instalasi melalui APT. Bisa dibaca disini :<br />
<br />
<a href="https://www.elastic.co/guide/en/elasticsearch/reference/current/setup-repositories.html#_apt" target="_blank">https://www.elastic.co/guide/en/elasticsearch/reference/current/setup-repositories.html#_apt</a><br />
<br />
Hanya kendalanya ketika proses instalasi selesai dan elastic search dicoba dijalankan, gagal.<br />
<br />
<blockquote class="tr_bq">
sudo /etc/init.d/elasticsearch status<br />
● elasticsearch.service - LSB: Starts elasticsearch<br />
Loaded: loaded (/etc/init.d/elasticsearch; bad; vendor preset: enabled)<br />
Active: active (exited) since Sel 2016-06-07 14:55:15 WIB; 4s ago<br />
Docs: man:systemd-sysv-generator(8)<br />
Process: 13459 ExecStop=/etc/init.d/elasticsearch stop (code=exited, status=0/SUCCESS)<br />
Process: 13528 ExecStart=/etc/init.d/elasticsearch start (code=exited, status=0/SUCCESS)<br />
Jun 07 14:55:15 openthinklabs002 systemd[1]: Starting LSB: Starts elasticsearch...<br />
Jun 07 14:55:15 openthinklabs002 elasticsearch[13528]: [warning] /etc/init.d/elasticsearch: No java runtime was found<br />
Jun 07 14:55:15 openthinklabs002 systemd[1]: Started LSB: Starts elasticsearch.</blockquote>
<div>
<br /></div>
<div>
Jika hal ini terjadi, install paket java-wrappers</div>
<div>
<br /></div>
<blockquote class="tr_bq">
sudo apt-get install java-wrappers</blockquote>
<div>
<br /></div>
<div>
Kemudian, jika sesudah menjalankan perintah : </div>
<div>
<br /></div>
<blockquote class="tr_bq">
sudo service elasticsearch start </blockquote>
<div>
<br /></div>
<div>
elasticsearch masih tidak dapat start, meskipun jika anda melihat output dari perintah :</div>
<div>
<br /></div>
<blockquote class="tr_bq">
sudo service elasticsearch status</blockquote>
<div>
<br /></div>
<div>
elasticsearch mengindikasikan telah berjalan. Hal ini kemungkinan besar adalah karena permasalah permission. </div>
<div>
<br /></div>
<div>
Untuk debugging, buatlah file run.sh dan buat executable yang berisi : </div>
<div>
<br /></div>
<div>
<blockquote class="tr_bq">
#!/bin/bash<br />
start-stop-daemon --start --user elasticsearch -c elasticsearch --pidfile /var/run/elasticsearch/elasticsearch.pid --exec /usr/share/elasticsearch/bin/elasticsearch -- -d -p /var/run/elasticsearch/elasticsearch.pid --default.config=/etc/elasticsearch/elasticsearch.yml --default.path.home=/usr/share/elasticsearch --default.path.logs=/var/log/elasticsearch --default.path.data=/var/lib/elasticsearch --default.path.work=/tmp/elasticsearch --default.path.conf=/etc/elasticsearch</blockquote>
</div>
<div>
<br /></div>
<div>
Dengan menjalankan perintah ini, penulis menemukan kesalahannya terletak pada file permisssion. </div>
<div>
<br /></div>
<div>
Berikut ini adalah hal-hal yang penulis lakukan agar elasticsearch dapat berjalan di ubuntu 16.04. </div>
<div>
<br /></div>
<div>
Buat folder /run/elasticsearch dan ubah ownershipnya: </div>
<div>
<br /></div>
<blockquote class="tr_bq">
mkdir /run/elasticsearch<br />
chown elasticsearch.elasticsearch /run/elasticsearch/</blockquote>
<div>
<br /></div>
<div>
edit file /etc/init.d/elasticsearch </div>
<div>
<br /></div>
<div>
Ubah baru 97 dari : </div>
<div>
<br /></div>
<blockquote class="tr_bq">
PID_FILE=/var/run/$NAME.pid</blockquote>
<div>
<br /></div>
<div>
menjadi : </div>
<div>
<br /></div>
<blockquote class="tr_bq">
PID_FILE=/var/run/elasticsearch/$NAME.pid</blockquote>
<div>
<br /></div>
<div>
Coba jalankan elasticsearch : </div>
<div>
<br /></div>
<div>
<blockquote class="tr_bq">
sudo service elasticsearch start</blockquote>
</div>
<div>
<br /></div>
<div>
Untuk memastikan elasticsearch bejalan coba jalankan : </div>
<div>
<br /></div>
<div>
<blockquote class="tr_bq">
curl http://localhost:9200/</blockquote>
</div>
<div>
<br /></div>
<div>
Muda-mudahan ada yang terbantu dengan tulisan singkat ini. </div>
<div>
<br /></div>
<h3>
Referensi</h3>
<div>
<ol>
<li>instance won't start on Ubuntu 14.04 #182, <a href="https://github.com/elastic/puppet-elasticsearch/issues/182" target="_blank">https://github.com/elastic/puppet-elasticsearch/issues/182</a></li>
</ol>
</div>
Wildan Maulanahttp://www.blogger.com/profile/03271713878662854306noreply@blogger.com0