Comments (7)
@Ziinc I have made the first step towards hexdocs. I kind of liked what I am getting after all, so I think I will shut down the current version of static docs in a while (in favor of the hexdocs).
Could you please have a glance on: #32
from crawly.
I usually collapse the docstrings with vscode. I was also wondering why you hadn't used ExDoc.
The developer docs is lacking, I still don't quite understand some parts of crawly, and i had to carefully follow function names when trying to understand the pipelines logic. I think using exdoc for a set of dev docs would be good.
i personally find that separating code and documentation (dev or user) makes it harder to keep them in sync.
from crawly.
Wow, that's a valuable feedback! Let me try to improve that part. Could you please raise an issue with things which was problematic in middlewares so I can create in improvement PR?
I would still separate the functions documentation with things like getting started/tutorials/examples/settings description (well I don't quite know if it's possible to describe settings properly with ExDoc) etc.
from crawly.
It's more to do with not having a single set of dev docs to look through and reference to know what each module and function is doing.
Actually, if I'm not wrong, hexdocs already automatically generates a set of docs using ExDoc:
https://hexdocs.pm/crawly/api-reference.html
I also notice that this ranks higher on google than the docsify page. I think its attributable to the JS only approach of docsify.
When it comes to ExDoc, I like how phoenix has done their guides section,which was user-friendly enough to get started, and is organized with separate markdown files in their repo. As for how dev docs is organized, I think the Elixir lang or Ecto module sections are the gold standard. Just the right level of depth with source code links to check implementation.
ExDoc already has inbuilt versioning, so i wouldn't worry about that.
from crawly.
I would give it a try. @Ziinc maybe you could point me to the guides implementation, e.g. I don't quite see where their sources are. (E.g. how can we integrate it into the root of the hex docs page)
from crawly.
Oops I didn't copy paste it correctly before.
The guides on hexdocs:
https://hexdocs.pm/phoenix/overview.html#content
and on github:
https://github.com/phoenixframework/phoenix/tree/master/guides
from crawly.
Done in PR #32
from crawly.
Related Issues (20)
- curl fetcher HOT 1
- Typespecs for crawly splash fetcher options are wrong
- Suggestion for nameing of closespider_timeout in config HOT 2
- Observed crash of Genserver HOT 1
- Generic `Pipeline crash` error HOT 4
- [question] scrapping dynamic urls HOT 1
- `Could not start application crawly` when trying to enter IEx HOT 2
- js render problem HOT 6
- custom parsar callback sample HOT 7
- Could not compile dependency :epipe HOT 5
- Demo page not loading HOT 3
- Setting up a parametric spider (dynamic base_url and start_urls) HOT 1
- Use a more reliable website to crawl in tutorial HOT 1
- Any working examples? HOT 4
- jl files not found probably not writing HOT 1
- Crawly.fetch giving 301 response instead of 200 HOT 1
- My Spider's code is never invoked, weird behavior with `Crawly.RequestsStorage.pop` in library code HOT 5
- This is actually a question, Nested scraping HOT 2
- Genserver time out crash in long-running pipeline HOT 1
- Stop and resume the spider where it stopped HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from crawly.