zilliztech / phantoscope Goto Github PK

Error: failed to open database: Meta Tables schema is created by Milvus old version. Possible reason: Meta Tables schema is damaged or created by in-compatible Milvus version.
/var/lib/milvus/docker-entrypoint.sh: line 7: 6 User defined signal 1 ./start_server.sh

error in search logs.

'SQLALCHEMY_TRACK_MODIFICATIONS adds significant overhead and '
/usr/local/lib/python3.6/dist-packages/flask_sqlalchemy/__init__.py:835: FSADeprecationWarning: SQLALCHEMY_TRACK_MODIFICATIONS adds significant overhead and will be disabled by default in the future.  Set it to True or False to suppress this warning.
  'SQLALCHEMY_TRACK_MODIFICATIONS adds significant overhead and '
[2020-05-26 02:59:29,221] ERROR in pipeline.pipeline 218: ('Execute with error', <_InactiveRpcError of RPC that terminated with:
	status = StatusCode.RESOURCE_EXHAUSTED
	details = "Received message larger than max (8725449 vs. 4194304)"
	debug_error_string = "{"created":"@1590461969.221399073","description":"Error received from peer ipv4:192.168.2.3:50001","file":"src/core/lib/surface/call.cc","file_line":1056,"grpc_message":"Received message larger than max (8725449 vs. 4194304)","grpc_status":8}

When meets this bug, load data crashed. (Need to fix it)
This error is fortuitous. record it.

As title, current result is below, and maybe inform me of bad image is better.

As noticed in the title.

Is your feature request related to a problem? Please describe.

remove mysql

Describe the solution you'd like

Describe alternatives you've considered

Additional context

Describe the bug
A clear and concise description of what the bug is.

• need to run the command[‘docker-compose up -d’] twice，table of mysql can be created successfully。
• upload images error：ERROR:root:Upload file 'xxx.jpg' error due to: name 'upload_url' is not defined。Becuase multiprocessing on Macos cannot access ‘upload_url’ in load_data.py

Steps/Code to reproduce behavior
Follow this guide to craft a minimal bug report. This helps us reproduce the issue you're having and resolve the issue more quickly.

Expected behavior
A clear and concise description of what you expected to happen.

Environment details

• Docker info
• Phantoscope version (v0.1.0)

Screenshots
If applicable, add screenshots to help explain your problem.

Additional context
Add any other context about the problem here.

Is your feature request related to a problem? Please describe.

Describe the solution you'd like

provide a tools for user install/upgrade

Describe alternatives you've considered

Additional context

command here
response.txt

{
    "fields": {
        "face": {
            "url": "https://tse2-mm.cn.bing.net/th/id/OIP.d0Uth461I3nJDr28WXudhgHaHa?w=204&h=189&c=7&o=5&dpr=2&pid=1.7"
        }
    },
    "topk": 5,
    "nprobe": 20
}

Describe the bug
0.2.0 search result not sort as distince

Steps/Code to reproduce behavior
not sort after find from mongo

Expected behavior
search result sort with distince

Environment details

• Docker info
• Phantoscope version v0.2.0

phantoscope 0.2.0

root@dssy-milvus:/home/phantoscope# ./scripts/prepare.sh

Register operators named vgg16
{"name": "vgg_encoder", "addr": "psoperator/vgg16-encoder:latest", "author": "ph antoscope", "version": "0.1.0", "type": "encoder", "description": "vgg16 encoder ", "runtime_client": "docker", "metadata": {"id": "94f0aa47-ede5-4d07-aeef-c78cd 8c4fbe0", "create_time": "2020-07-28 06:20:44.427142", "resource_type": "Operato r", "state": "created"}}\n
create operator instance
curl: (52) Empty reply from server
\nsleep 10s for instance warmup
Create pipeline with created instance vgg16
{"message": "No such container: phantoscope_vgg_encoder_vgg_instance1", "error": "DockerRuntimeError"}\nCreate application with the created pipeline before
{"message": "pipeline example_pipeline not exist", "error": "ArgsCheckError"}

which step is wrong?

Describe the bug
api server not creat database correctly

Steps/Code to reproduce behavior

Expected behavior

Environment details

• Phantoscope version (v0.1.0)
• wsl 2.0

Screenshots

Additional context

There are too much base64 target fields in result. Why is it designed so?

error log here
error.log

Failed dut to wrong order of 'docker run ' params

'Make all' is not implemented in Makefile.
error log:
make: *** No rule to make target 'all'. Stop.

curl --location --request POST '192.168.2.3:5000/v1/operator/regist' \
--header 'Content-Type: application/json' \
--data-raw '{
    "endpoint": "192.168.2.3:50011",
    "name": "xception"
}'

Endpoint of operator information is from operator result, but It must now is default 127.0.0.1
So, any docker operator must be set OP_ENDPOINT environment.
Any other good idea?

我的执行步骤
1.下载 Phantoscope
git clone https://github.com/zilliztech/phantoscope.git -b 0.1.0
cd phantoscope

2.设置环境变量
$ export LOCAL_ADDRESS=$(ip a | grep -Eo 'inet (addr:)?([0-9].){3}[0-9]' | grep -Eo '([0-9].){3}[0-9]' | grep -v '127.0.0.1'| head -n 1)

3.启动 Phantoscope 容器：
$ sudo docker-compose up -d

4.检查所有容器状态
$ sudo docker-compose ps
Ok

5.创建pipeline
chmod +x scripts/prepare.sh
./scripts/prepare.sh

这儿返回了错误：
{"message": "opeartor vgg16 regist error", "error": "OperatorRegistError"}{"message": "query from sql error", "error": "QueryFromSQLError"}{"message": "query from sql error", "error": "QueryFromSQLError"}

Report incorrect documentation

0.2.0 docs is perpared now. Some tags should be fixed to 0.1.0 instead of latest.

Location of incorrect documentation
All document should be checked.

Describe the problems or issues found in the documentation
0.2.0 docs is perpared now. Some tags should be fixed to 0.1.0 instead of latest.

Steps taken to verify documentation is incorrect
All commands in 0.1.0 will be true after 0.2.0 image uploaded.

Suggested fix for documentation
None

Report needed documentation

Maybe a doc about multi branch example is welcomed.

if more than one machine, how do use operator register and create ,or how do use k8s ?
thank!

Can't Run load_data.py

Location of incorrect documentation
Upload Image Package

Describe the problems or issues found in the documentation

1. support assigned application_name
2. support getting fields by get aplication information
3. support setting data path by command

wget https://github.com/zilliztech/phantoscope/blob/master/docker-compose.yml
This link downloads the entire webpage。

It should be downloaded using this link：
wget https://raw.githubusercontent.com/zilliztech/phantoscope/master/docker-compose.yml

1. 6000 port is not the quick start recommanded port
2. run failed: Object of type 'bytes' is not JSON serializable

When I delete all and restart, the first 'docker-compose' is failed.
error.log

Endpoint can not be 127.0.0.1. It should be edited as local area ip.
How can it work more convenient?

Delete app failed due to foreign key when I upload images

In upload images:

        tar xvf /tmp/vgg-example.tar
	python load_data.py

first command must in '/tmp' path and second must be executed in '/path_to_omnisearch/docs/quick_start'

设置环境变量
export LOCAL_ADDRESS=$(ip a | grep -Eo 'inet (addr:)?([0-9].){3}[0-9]' | grep -Eo '([0-9].){3}[0-9]' | grep -v '127.0.0.1'| head -n 1)

Phantoscope 正在运行:
phantoscope_api_1 /usr/bin/gunicorn3 -w 4 -b ... Up 0.0.0.0:5000->5000/tcp
phantoscope_milvus_1 /var/lib/milvus/docker-ent ... Up 0.0.0.0:19530->19530/tcp, 0.0.0.0:8080->8080/tcp
phantoscope_minio_1 /usr/bin/docker-entrypoint ... Up 0.0.0.0:9000->9000/tcp
phantoscope_mongo_1 docker-entrypoint.sh mongod Up 0.0.0.0:27017->27017/tcp
phantoscope_mysql_1 docker-entrypoint.sh mysqld Up 0.0.0.0:3306->3306/tcp
phantoscope_vgg_1 python3 server.py Up 0.0.0.0:50001->50001/tcp

运行 scripts 文件夹下的 prepare.sh 脚本 出现错误
./scripts/prepare.sh
{"message": "opeartor vgg16 regist error", "error": "OperatorRegistError"}{"message": "operator vgg16 not exist", "error": "NotExistError"}{"message": "pipeline not exist", "error": "NotExistError"}

ERROR in operators.operator 103: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "failed to connect to all addresses"

$ make all
PYTHONPATH=/home/abner/workspace/git/omnisearch/search pytest tests
================================================================================ test session starts ================================================================================
platform linux -- Python 3.6.9, pytest-5.3.5, py-1.8.1, pluggy-0.13.1
rootdir: /home/abner/workspace/git/omnisearch
collected 0 items / 1 error

====================================================================================== ERRORS =======================================================================================
_______________________________________________________________________ ERROR collecting tests/test_utils.py ________________________________________________________________________
ImportError while importing test module '/home/abner/workspace/git/omnisearch/tests/test_utils.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
tests/test_utils.py:2: in
from common.utils import save_tmp_file
E ModuleNotFoundError: No module named 'common.utils'
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Interrupted: 1 error during collection !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
================================================================================= 1 error in 0.04s ==================================================================================
Makefile:9: recipe for target 'test' failed
make: *** [test] Error 2

error here

something error: Exiting device scope without proper scope nesting.

No any license statement is mentioned in source code, currently.

As title

Maybe it is better to change host from '192.168.1.10' to '127.0.0.1' in docker-compose.yml.

Is your feature request related to a problem? Please describe.

None

Describe the solution you'd like
Support create application pipeline operator created by yaml file

Describe alternatives you've considered

Additional context

location:
https://github.com/zilliztech/Phantoscope/blob/0.1.0/docs/site/zh-CN/tutorials/operator.md

I think it should add more information