Recently there is a small project, don't know where to begin!

This: to develop a data crawler software, grab a site data, but the core of the crawler all their code on the server side, c #, after all, crack too much, so I put the core code on the server side, can not crack, the client USES the registration certificate, and then extract the website of cookies, spread to the server, the server after fetching data analysis to the client and, according to


Excuse me each ace of development experience, I where to begin? Server is ali cloud!
I always don't understand is:
1. The client and server, generally using at ease for data transfer?
2. If there is more than a client query data, how to deal with each user's request on the server?

Hope that philosophers give some train of thought, if there are specific examples of reference would be even better! Thank you brother

CodePudding user response:

The premise is don't know what you will, from your description, what seems to be can't service program development, it is difficult to answer,

CodePudding user response:

Actually I also is a rookie, but also are doing similar programs, so answer, also earn points,
Server and client to establish a TCP socket, best with timer do heartbeat,
Break automatic reconnection mechanism and application on, (I have found that even in a wireless local area network (LAN), socket communication or is broken is broken,)
As for the code, you can baidu,
Now write programs is to move the brick, copy some here and there to copy, with respect to OK,

CodePudding user response:

reference 1st floor sp1234 response:

premise is don't know what you will, from your description, what seems to be can't service program development, it is difficult to answer,

I can only use c # development of desktop applications, think of this, but I don't know where to start

CodePudding user response:

1. You need to write a custom protocol, but it is best to have understood the HTTP protocol,
2. A preliminary way to do it, can use the connection pool

CodePudding user response:

reference hufanrong123 reply: 3/f

Quote: refer to 1st floor sp1234 response:

Premise is don't know what you will, from your description, what seems to be can't service program development, it is difficult to answer,

I can only use c # development of desktop applications that want to proceed with this, but I don't know where to start

We can write a write Socket,

CodePudding user response:

I am now in learning database with the server is also do not understand, a great god give advice or comments, please,

CodePudding user response:

The crawler this is good,
I am considering made a simple function of the crawler

CodePudding user response:

Is this your crawler? What now seems like the client to provide your web address, account password, and then you weigh him within the url specified grab what customers want to clients look, don't know I don't understand

CodePudding user response:

HTTP, the cookies as a parameter to the server, the server to accept and return after processing, and validation, the need to use in front of the winform, behind the aspx + SQL

CodePudding user response:

Use WCF design conforms to the restful specification of host and client, communication is very convenient, the get and post something fast,