The pinba-server from pinba-server

pinba-server's Introduction

Requirements

php
clickhouse

Installation

cd /opt
git clone https://github.com/pinba-server/pinba-server.git
cd pinba-server
php composer.phar install
clickhouse-client -n < clickhouse/pinba.requests.sql

Usage

php workerman_clickhouse.php start -d
php workerman_clickhouse.php stop

Systemd autostart script

sudo cp systemd/pinba-server.service /usr/lib/systemd/system/pinba-server.service
sudo systemctl daemon-reload && systemctl enable pinba-server && systemctl start pinba-server

Stats for 24 hours with about 10 RPS on php-fpm and 450 RPS on nginx:

table	rows	size, Mb	description
requests	1kk	26	raw data
report_by_all	56k	2	aggregated data by minutes
nginx_requests	45kk	0	raw data, engine=null
nginx_report_by_all	300k	9	aggregated data by minutes

Info

publications: reddit(en), habr(ru)
the installation of ClickHouse, pinba-server, pinba module for php and nginx on Ubuntu 18.04 LTS and Centos 7.

Grafana

dashboard #10011

License

MIT License.

Contributors

Stargazers

Watchers

pinba-server's Issues

Results are too big to render in a browser

We just set everything up as per the instruction, but in result we got huge chunks of data returned by several queries into our browsers

For example this one returns 16.6MB of data and it takes 2 minutes to just execute:

WITH (CASE          WHEN (6000 % 60) = 0 THEN 6000     ELSE 60 END ) AS scale 
SELECT     intDiv(toUInt32(timestamp), scale) * scale * 1000 AS t,     SUM(req_count) * 60 / scale as req_count,     script_name || ':' || toString(status) as script_name 
FROM pinba.report_by_all WHERE     timestamp >= toDateTime(1557658981)     AND CASE 
WHEN 'all' <> 'all' THEN schema = 'all' ELSE 1 END     AND CASE WHEN 'all' <> 'all' THEN hostname = 'all' ELSE 1 END     AND CASE WHEN 'all' <> 'all' THEN server_name = 'all' ELSE 1 END
GROUP BY script_name, t 
ORDER BY t, req_count desc FORMAT JSON

We have 2M rows of data in our DB (that's not so much, i think), but it already doesn't work, browser's tab just freeezes.

Has anyone run into the same problem?

Does it works from php cli?

We have php cli that runs from screen in manual mode. Will it works in this situtation?

Данные не идут в ClickHouse как найти причину?

Добрый день, воспользовались вот этой инструкцией https://habr.com/ru/post/444610/, установили protobuf.so, pinba.so для php 7.2 и в Grafana пусто.

В настройках Grafana подключение к ClickHouse настроено и тест подключения проходит успешно

Как можно проверить что данные идут в порт 30002 ?

Через консоль подключались к clickhouse-client и делали SELECT по таблицам из дампа, таблицы есть, но везде пусто

Что мы делаем не так?

CentOS Linux release 7.7.1908 (Core)

Ещё в Grafana после установки готового шаблона вылазит ошибка

Recommend Projects

pinba-server / pinba-server Goto Github PK