Giter Club home page Giter Club logo

amappoi's Introduction

Hi, I'm Civitasv, a passionate C++ developer. 💬 Ask me about anything, I am happy to help.

Neovim Projects

cmake-tools.nvim: CMake integration in Neovim cmake-tools.nvim: CMake integration in Neovim   runvim: Beautiful, fast, functional Configuration for Neovim. runvim: Beautiful, fast, functional Configuration for Neovim.  

C++ Projects

asciichart: Nice-looking lightweight console ASCII line charts, using C++, no dependencies. asciichart: Nice-looking lightweight console ASCII line charts, using C++, no dependencies.   mini-json-parser: A Tiny Json Parser mini-json-parser: A Tiny Json Parser  

Other Projects

AMapPoi: POI 搜索工具、地理编码工具 AMapPoi: POI 搜索工具、地理编码工具  

Civitasv: Civitasv's GitHub Stats Civitasv: Civitasv's GitHub Stats  

amappoi's People

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

amappoi's Issues

POIKit-2.0.1启动问题求助

您好开发者,在使用最新版的POIKit时,点击star会显示:

E:\POIKit-2.0.1>cd app

E:\POIKit-2.0.1\app>java -jar spider.jar
错误: 找不到或无法加载主类 com.civitasv.spider.MainApplication
原因: java.lang.NoClassDefFoundError: javafx/application/Application

请问该如何解决,十分感谢您开发的软件!

不同阈值导致爬取结果差异较大

感谢开发者提供的工具,非常方便!
可是这里有一个问题想要确认一下,我在抓取南京市的地铁站出入口时,如果按照如下设置
image
即将切分阈值设为默认的850时,只能获取200多个地铁站出入口。
但是如果把阈值调整到100,则可以获取778个,调整为10,则可以获取780个(780应该是全的)。
所以这里是想和开发者确认一下阈值这个参数是作用于所有poi还是说仅作用于任务涉及到的poi呢?该阈值为什么在这个任务中会有如此大的差异,通常来说设为多少更合理呢?
期待您的回复!

POIKIT2.0版本_基础功能使用疑问

十分感谢各位老师百忙之中阅读我的邮件,以下是我的问题:

使用POIkit过程中,输入【行政区】代码可以成功输出,但输入【自定义】区域geojson文件却没办法输出,显示“开始POI爬取,请勿操作-解析用户geojson文件中-成功解析用户文件”,就此卡住。

我仔细检查我简单的geojson文件没问题,希望老师有空的时候能帮帮我,这对我真的很重要,十分感谢。

附文件代码:

{
"type": "FeatureCollection",
"features": [
{
"type": "Feature",
"properties": {},
"geometry": {
"type": "Polygon",
"coordinates": [
[
[
119.30860519409178,
41.60697150486485
],
[
119.28757667541502,
41.59509765066552
],
[
119.31075096130373,
41.5806535322673
],
[
119.3407917022705,
41.59124620173383
],
[
119.30860519409178,
41.60697150486485
]
]
]
}
}
]
}

Mac系统start.sh无法运行

在配置好环境变量以后,把start.sh拖进终端执行,终端会显示,Unable to access jarfile spider.jar

[BUG]

你好,最近在使用poikit的0.0.7版本时,发现在爬取一二线城市(例如北京、上海、广州、武汉等)的poi数据时,如果poi代码输入的是数据量较大的050000或者是060000,则会出现两种情况:1)停住不动,就一直停在还剩多少多少个数据那儿。2)爬到中途会提示key池用尽,可是明明key池还有很多的剩余量。PS:本人在爬取时同时输入了3个账号的key。

[feature]加入提取POI的评价信息

首先非常感谢制作团队,能帮助我们非技术背景出身的研究者方便获取POI。

如果方便的话,再次想向开发团队提一个请求。请问是否能够加入提取“景点”,“餐饮”,“酒店”,“服务”等类别POI的评价信息,可能包括:
(1)评分;
(2)近期内多少人到访或者查看

这些信息中,(1)评分在高德地图API中的返回值有提及(https://lbs.amap.com/api/webservice/guide/api/search)
(2)到访次数的信息我能以用户角度在手机app中查看,但不知道如何通过API提取。有一篇学术论文提到了可以提取到访次数信息。(https://www.sciencedirect.com/science/article/pii/S0048969719332747)

非常感谢您的考虑。

祝好

行政区边界无法获取

问题

无法获取行政区边界,请检查行政区代码后重试

异常:

javax.net.ssl.SSLHandshakeException: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
        at sun.security.ssl.Alert.createSSLException(Alert.java:131)
        at sun.security.ssl.TransportContext.fatal(TransportContext.java:370)
        at sun.security.ssl.TransportContext.fatal(TransportContext.java:313)
        at sun.security.ssl.TransportContext.fatal(TransportContext.java:308)
        at sun.security.ssl.CertificateMessage$T12CertificateConsumer.checkServerCerts(CertificateMessage.java:652)
        at sun.security.ssl.CertificateMessage$T12CertificateConsumer.onCertificate(CertificateMessage.java:471)
        at sun.security.ssl.CertificateMessage$T12CertificateConsumer.consume(CertificateMessage.java:367)
        at sun.security.ssl.SSLHandshake.consume(SSLHandshake.java:376)
        at sun.security.ssl.HandshakeContext.dispatch(HandshakeContext.java:479)
        at sun.security.ssl.HandshakeContext.dispatch(HandshakeContext.java:457)
        at sun.security.ssl.TransportContext.dispatch(TransportContext.java:200)
        at sun.security.ssl.SSLTransport.decode(SSLTransport.java:154)
        at sun.security.ssl.SSLSocketImpl.decode(SSLSocketImpl.java:1290)
        at sun.security.ssl.SSLSocketImpl.readHandshakeRecord(SSLSocketImpl.java:1199)
        at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:401)
        at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:373)
        at okhttp3.internal.connection.RealConnection.connectTls(RealConnection.kt:379)
        at okhttp3.internal.connection.RealConnection.establishProtocol(RealConnection.kt:337)
        at okhttp3.internal.connection.RealConnection.connect(RealConnection.kt:209)
        at okhttp3.internal.connection.ExchangeFinder.findConnection(ExchangeFinder.kt:226)
        at okhttp3.internal.connection.ExchangeFinder.findHealthyConnection(ExchangeFinder.kt:106)
        at okhttp3.internal.connection.ExchangeFinder.find(ExchangeFinder.kt:74)
        at okhttp3.internal.connection.RealCall.initExchange$okhttp(RealCall.kt:255)
        at okhttp3.internal.connection.ConnectInterceptor.intercept(ConnectInterceptor.kt:32)
        at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.kt:109)
        at okhttp3.internal.cache.CacheInterceptor.intercept(CacheInterceptor.kt:95)
        at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.kt:109)
        at okhttp3.internal.http.BridgeInterceptor.intercept(BridgeInterceptor.kt:83)
        at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.kt:109)
        at okhttp3.internal.http.RetryAndFollowUpInterceptor.intercept(RetryAndFollowUpInterceptor.kt:76)
        at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.kt:109)
        at okhttp3.internal.connection.RealCall.getResponseWithInterceptorChain$okhttp(RealCall.kt:201)
        at okhttp3.internal.connection.RealCall.execute(RealCall.kt:154)
        at retrofit2.OkHttpCall.execute(OkHttpCall.java:204)
        at com.civitasv.spider.dao.impl.DataVDaoImpl.getBoundary(DataVDaoImpl.java:17)
        at com.civitasv.spider.util.BoundaryUtil.getBoundaryAndAdNameByAdCode(BoundaryUtil.java:35)
        at com.civitasv.spider.controller.POIController.getBoundaryByAdCode(POIController.java:338)
        at com.civitasv.spider.controller.POIController.lambda$execute$10(POIController.java:220)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
Caused by: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
        at sun.security.validator.PKIXValidator.doBuild(PKIXValidator.java:439)
        at sun.security.validator.PKIXValidator.engineValidate(PKIXValidator.java:306)
        at sun.security.validator.Validator.validate(Validator.java:271)
        at sun.security.ssl.X509TrustManagerImpl.validate(X509TrustManagerImpl.java:312)
        at sun.security.ssl.X509TrustManagerImpl.checkTrusted(X509TrustManagerImpl.java:221)
        at sun.security.ssl.X509TrustManagerImpl.checkServerTrusted(X509TrustManagerImpl.java:128)
        at sun.security.ssl.CertificateMessage$T12CertificateConsumer.checkServerCerts(CertificateMessage.java:636)
        ... 36 more
Caused by: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
        at sun.security.provider.certpath.SunCertPathBuilder.build(SunCertPathBuilder.java:141)
        at sun.security.provider.certpath.SunCertPathBuilder.engineBuild(SunCertPathBuilder.java:126)
        at java.security.cert.CertPathBuilder.build(CertPathBuilder.java:280)
        at sun.security.validator.PKIXValidator.doBuild(PKIXValidator.java:434)
        ... 42 more

参数设置

开发者类型:个人开发者
POI关键字:KFC
行政区:310000
切分阈值:850
线程数目:5
输出格式:csv

环境

  • jdk 版本:1.8.0_291
  • POIKit 版本:0.0.6

截图

FYH7J6Y6L)@`HGSC8{4_AGY

调用量超出限制后任务停止,但是无数据导出

非常感谢制作团队开发的优秀软件帮助我解决了很多问题!
但是我在程序运行过程中遇到一个奇怪的问题:当账号调用量超出限制后,已收集的POI数据却一直停留在保存任务状态,而没有任何数据导出,请问这是什么原因呢?
已执行任务:2619/3160
已执行任务:2620/3160
errorCode: 10044
errorMessage: 账号维度日调用量超出限制
helpInfo:账号维度日调用量超出限制,超出部分的请求被拒绝。限流阈值内的请求依旧会正常返回
停止POI爬取
任务即将停止,正在保存任务状态...请不要关闭软件

有网站售卖你们的工具

问题

这里详细描述您的问题

参数设置

这里描述您产生该问题使用的参数

环境

  • jdk 版本
  • POIKit 版本

重现步骤

告诉开发者如何重现该错误

截图

一张或多张该问题相关截图

有网站售卖你们的工具
https://giscloud.com.cn/547.html

feedback

Windows系统中点击start.bat后的界面(我已经完成环境配置)
S:\POIKIT\POIKit-2.0.2>cd app

S:\POIKIT\POIKit-2.0.2\app>java -jar spider.jar
错误:无法找到或装入主类 com.civitasv.spider.MainApplication

S:\POIKIT\POIKit-2.0.2\app>pause
请按任意键继续. . .

解决高版本不会自带javafx库的问题

解决高版本不会自带javafx库的问题:

  1. JavaFX - Gluon (gluonhq.com)上下载JavaFX包。其中,JavaFX version、Operating System、Architecture根据你的Java版本和操作系统选择,Type选择SDK。

  2. start.bat同目录下,命令行输入:

    Windows

    java --module-path your\download\path\to\javafx-sdk\lib --add-modules javafx.controls,javafx.fxml -jar app\geospider.jar

    your\download\path\to\javafx-sdk\lib换成你下载解压出来的JavaFX包lib地址。

    LInux

    把反斜杠\替换为正斜杠/

赞赞赞

太强了,直接解决了python迭代问题,我还在想要不要分块一点点做,膜拜大佬
src=http___image biaobaiju com_uploads_20191102_15_1572678922-dJLfpblhRG jpeg refer=http___image biaobaiju

POI无法导出

在爬取完一个城市相关poi共有6万条后,一直卡在该区域包含poi69481万条进度,无生成数据。

errorCode : 90003

请问一下出现了errorCode : 90003;显示信息errorMessage : 任务终止 --- com.google.gson.JsonSyntaxException: java.lang.IllegalStateException: Expected a string but was BEGIN_ARRAY at line 1 column 2959 path $.pois[8].name
怎么办呢

GeoJSON范围爬取失败

image
image
按GeoJSON范围爬取失败,表现为读取文件后卡住不动,上面是使用到的参数,在老版本进行测试是能够顺利运行的

poi最多1000条

你好,最近在这poi数据采集,有什么办法查到某个城市比如深圳,所有餐饮店的poi数据呢
目前知道的是缩小搜索范围和类别,比如根据区县级编码和三级分类,但有没有更好的方式?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.