Giter Club home page Giter Club logo

elfk-redis's Introduction

ELFK_redis

STEP 1 install mysql-redis on docker-compose

cd ./ELFK-redis/mysql-redis
docker-compose up -d

listening port:6379 make sure remember the psw and host for a running redis. default psw 123456

STEP 2 install ELK

# Notes:
# modify ELFK verison in ./ELFK-redis/.env
# modify redis host & psw in ./ELFK-redis/.env

cd ./ELFK-redis/
docker-compose up -d

STEP 3 install Filebeat

# Notes:
# modify args in ./filebeat_compose/.env

cd filebeat_compose/
docker-compose up -d

STEP 4 navigate to ES/Kibana to config

部分metadata字段如"_index", "id"等,无法在logstash前置环节去掉,因此需要到登陆kibana手动设置屏蔽字段,也可直接在kibana设置中直接屏蔽所有多余字段
1、登陆kibana,左侧导航栏 Stack Management => Advanced Settings
2、在上方的设置搜索框,搜索 "Meta", 定位到metaFields setting, 将输入框中的所有字段删除。
3、保存设置 4、左侧导航栏,选择Kibana-Index Patterns => 选择Fieldfilters, 依次输入四个关键词并Add,
log.offset
message.keyword
log.flags*
log.file.path.keyword
5、上方选择Fields,点击log.file.path后方的编辑按钮,打开set format按钮,选择Static Lookup,输入映射如下图: https://github.com/hellopahe/ELFK-redis/blob/main/sample/kibana_6.png

Elastic/Kibana
http://yourhost:9200/_cat/indices
http://yourhost:5601/

feature A 「将Elastic数据持久化」

step 1# 在docker-compose中es部分添加参数
        volumes:
              - /usr/share/elasticsearch
step 2# 运行docker
        docker inspect elasticsearch查看挂载情况
step 3# 前往本地目录“Source”管理文件

elfk-redis's People

Contributors

hellopahe avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.