Comments (7)
Hi! A novice programmer here. I would like to work on this.
from linkcrawler.
hello @sourangshu24
This task could be a bit more complicated than I first thought.
Since the application is using asynch functions, you need to research how you can know when the program is finished running. Maybe we need to change some parts of the LinkCrawler.cs.
from linkcrawler.
Hi @hmol ! I was thinking more on the lines of modifying Program.cs to store the local system times ( for start and end times) before a call to linkCrawler.Start() is made and before Console.Read() is called respectively. I supppose even async calls will finish by the time control jumps back to Program.cs to call Console.Read(). Please correct me if I am wrong and if my approach is wrong.
from linkcrawler.
Yeah, you can clone my repo and test it if you want :)
Read about async here https://msdn.microsoft.com/en-us/library/mt674882.aspx
Thing is, all the method-calls that will fetch markup and find broken links will be async. So I suspect that the program will go to Console.Read()
before it has finished the crawling.
Put Console.WriteLine("This is the end.")
in line above Console.Read()
to test.
from linkcrawler.
I tested it as you suggested, and you are right! It does show "This is the end" at the beginning. Going back to your earlier suggestion of changing the LinkCrawler.cs file itself, i think a Stopwatch object should do the trick if i include it before calling the async function. But I need to research how to know when an async function has stopped executing.
from linkcrawler.
@hmol, I have sent a pull request for this
f4f3b35
from linkcrawler.
Think I've got a solution to this. Don't want to tread on any toes though - is anyone else actively working on this?
from linkcrawler.
Related Issues (20)
- Define (in app.config) what http-statuscodes to treat as success
- All IOutput implementations are always used HOT 2
- Question - Twitter support HOT 8
- Proxy support
- SMTP support HOT 2
- Exception when writing output to CSV HOT 4
- Improve summary to include breakdown of link counts by status HOT 6
- Moved URL's aren't crawled HOT 2
- Local links HOT 1
- dotnet core anyone? HOT 3
- Pass url as a command line argument HOT 5
- local links shown as missing HOT 3
- Support sites with login or with age gate HOT 1
- Follow redirects feature HOT 2
- Broken henrikm.com links in README
- Broken links on Readme
- Create a Unit test to check for a valid URL
- sorry. please delete this issue
- Is this even working ?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from linkcrawler.