How can `wget` get more logs when it gets errorHow to download pdf files referenced by pages one or two levels inside of the seedHow were these Linux TCP default settings decided?using wget to download all audio files (over 100,000 pages on wikia)Claiming IP address from CentOS 7 serverHow to access http server from bash script with existing tcp connection?Servers receiving intermittent timeouts - is my IPTables config OKproftpd kills session with 421 timeout error messagespurious TCP reset with IP id 0 from linux based forwarderConnection errors on Apache httpd proxy, but only for some vhostThe nginx provide data download rate is not meet the iperf3 test
Arthur Somervell: 1000 Exercises - Meaning of this notation
Minkowski space
Show that if two triangles built on parallel lines, with equal bases have the same perimeter only if they are congruent.
How old can references or sources in a thesis be?
Can a Warlock become Neutral Good?
How is it possible to have an ability score that is less than 3?
tikz: show 0 at the axis origin
What's the point of deactivating Num Lock on login screens?
Risk of getting Chronic Wasting Disease (CWD) in the United States?
Accidentally leaked the solution to an assignment, what to do now? (I'm the prof)
"to be prejudice towards/against someone" vs "to be prejudiced against/towards someone"
How does strength of boric acid solution increase in presence of salicylic acid?
To string or not to string
How is the claim "I am in New York only if I am in America" the same as "If I am in New York, then I am in America?
What do three bars across the stem of a note mean?
Fencing style for blades that can attack from a distance
Why doesn't H₄O²⁺ exist?
How can I prevent hyper evolved versions of regular creatures from wiping out their cousins?
Pattern match does not work in bash script
Can I make popcorn with any corn?
Email Account under attack (really) - anything I can do?
Why do I get two different answers for this counting problem?
Do I have a twin with permutated remainders?
can i play a electric guitar through a bass amp?
How can `wget` get more logs when it gets error
How to download pdf files referenced by pages one or two levels inside of the seedHow were these Linux TCP default settings decided?using wget to download all audio files (over 100,000 pages on wikia)Claiming IP address from CentOS 7 serverHow to access http server from bash script with existing tcp connection?Servers receiving intermittent timeouts - is my IPTables config OKproftpd kills session with 421 timeout error messagespurious TCP reset with IP id 0 from linux based forwarderConnection errors on Apache httpd proxy, but only for some vhostThe nginx provide data download rate is not meet the iperf3 test
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;
I have several questions about wget tool in linux:
# wget http://www.jdfschool.com
--2019-04-05 02:33:44-- (Trys: 3) http://www.jdfschool.com/
Connecting www.jdfschool.com|115.28.223.13|:80... Connected.
An HTTP request has been issued, waiting for a response... Connection reset by peer.
Retrying.
Is the
ConnectedofConnecting www.jdfschool.com|115.28.223.13|:80... Connected.represent TCP connected?You see the
Connection reset by peerin the log, is there any more detail logs of it? I can't know the reason of the reset issue.
linux centos wget
edited 2 days ago
muru
37.2k589164
asked 2 days ago
244boy244boy
1405
add a comment |
I have several questions about wget tool in linux:
# wget http://www.jdfschool.com
--2019-04-05 02:33:44-- (Trys: 3) http://www.jdfschool.com/
Connecting www.jdfschool.com|115.28.223.13|:80... Connected.
An HTTP request has been issued, waiting for a response... Connection reset by peer.
Retrying.
Is the
ConnectedofConnecting www.jdfschool.com|115.28.223.13|:80... Connected.represent TCP connected?You see the
Connection reset by peerin the log, is there any more detail logs of it? I can't know the reason of the reset issue.
linux centos wget
edited 2 days ago
muru
37.2k589164
asked 2 days ago
244boy244boy
1405
@muru welcome back!
– Rui F Ribeiro
2 days ago
add a comment |
I have several questions about wget tool in linux:
# wget http://www.jdfschool.com
--2019-04-05 02:33:44-- (Trys: 3) http://www.jdfschool.com/
Connecting www.jdfschool.com|115.28.223.13|:80... Connected.
An HTTP request has been issued, waiting for a response... Connection reset by peer.
Retrying.
Is the
ConnectedofConnecting www.jdfschool.com|115.28.223.13|:80... Connected.represent TCP connected?You see the
Connection reset by peerin the log, is there any more detail logs of it? I can't know the reason of the reset issue.
linux centos wget
edited 2 days ago
muru
37.2k589164
asked 2 days ago
244boy244boy
1405
I have several questions about wget tool in linux:
# wget http://www.jdfschool.com
--2019-04-05 02:33:44-- (Trys: 3) http://www.jdfschool.com/
Connecting www.jdfschool.com|115.28.223.13|:80... Connected.
An HTTP request has been issued, waiting for a response... Connection reset by peer.
Retrying.
Is the
ConnectedofConnecting www.jdfschool.com|115.28.223.13|:80... Connected.represent TCP connected?You see the
Connection reset by peerin the log, is there any more detail logs of it? I can't know the reason of the reset issue.
linux centos wget
linux centos wget
edited 2 days ago
muru
37.2k589164
asked 2 days ago
244boy244boy
1405
edited 2 days ago
muru
37.2k589164
asked 2 days ago
244boy244boy
1405
edited 2 days ago
muru
37.2k589164
edited 2 days ago
muru
37.2k589164
edited 2 days ago
muru
37.2k589164
37.2k589164
asked 2 days ago
244boy244boy
1405
asked 2 days ago
244boy244boy
1405
asked 2 days ago
244boy244boy
1405
1405
@muru welcome back!
– Rui F Ribeiro
2 days ago
add a comment |
@muru welcome back!
– Rui F Ribeiro
2 days ago
@muru welcome back!
– Rui F Ribeiro
2 days ago
@muru welcome back!
– Rui F Ribeiro
2 days ago
add a comment |
1 Answer
1
active
oldest
votes
As you correctly assume, 80... Connected means a (web) service is listening on port 80, and you were able to connect to it.
If the site is working well when using a browser (and also from other IP address) connection reset by peer only gives you a feedback whatever you are trying to do, does not somewhat work. If you want more details, you can try to sniff the connection.
However, short of asking the owner of site for logs/debugging, I pretty much doubt you will get more data about the reasons behind it being reset otherwise.
As for the causes, it might be that they have rules to not accept your user agent/spiders/have specific pages/or configurations that trow purposefully that error or also block you after n tries/pages in a defined time frame (defined by them).
As commented before, this is more related to specific site security measures and configurations than a Unix issue per se.
For listening to the actual HTTP requests, you can also run in your machine:
# ngrep -q "." "port 80"
or
# ngrep -q "." "port 80 and host www.jdfschool.com"
Mind you that depending also on configurations, HTML, DNS and infra-structure setup, it is not a given the second ngrep will listen to all HTTP requests.
As @muru states in comments, using
wget -v http://www.jdfschool.com
also might output more useful data.
As talked before, the odds of pinpoint exactly why is happening is slim. (In Apache web servers it is common to setup mod_evasive and mod_security to curb on spiders/abusive behaviour, for instance)
TLDR From the point of view of the site owner, what is happening to your command might well be intended behaviour.
answered 2 days ago
Rui F RibeiroRui F Ribeiro
41.9k1483142
1
More verbose outputwget -vmay help to see at what stage the connection was closed, maybe. (Thanks, by the way!)
– muru
2 days ago
1
wget -vget no more logs.
– 244boy
2 days ago
add a comment |
Your Answer
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "106"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f510412%2fhow-can-wget-get-more-logs-when-it-gets-error%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
As you correctly assume, 80... Connected means a (web) service is listening on port 80, and you were able to connect to it.
If the site is working well when using a browser (and also from other IP address) connection reset by peer only gives you a feedback whatever you are trying to do, does not somewhat work. If you want more details, you can try to sniff the connection.
However, short of asking the owner of site for logs/debugging, I pretty much doubt you will get more data about the reasons behind it being reset otherwise.
As for the causes, it might be that they have rules to not accept your user agent/spiders/have specific pages/or configurations that trow purposefully that error or also block you after n tries/pages in a defined time frame (defined by them).
As commented before, this is more related to specific site security measures and configurations than a Unix issue per se.
For listening to the actual HTTP requests, you can also run in your machine:
# ngrep -q "." "port 80"
or
# ngrep -q "." "port 80 and host www.jdfschool.com"
Mind you that depending also on configurations, HTML, DNS and infra-structure setup, it is not a given the second ngrep will listen to all HTTP requests.
As @muru states in comments, using
wget -v http://www.jdfschool.com
also might output more useful data.
As talked before, the odds of pinpoint exactly why is happening is slim. (In Apache web servers it is common to setup mod_evasive and mod_security to curb on spiders/abusive behaviour, for instance)
TLDR From the point of view of the site owner, what is happening to your command might well be intended behaviour.
answered 2 days ago
Rui F RibeiroRui F Ribeiro
41.9k1483142
1
More verbose outputwget -vmay help to see at what stage the connection was closed, maybe. (Thanks, by the way!)
– muru
2 days ago
1
wget -vget no more logs.
– 244boy
2 days ago
add a comment |
As you correctly assume, 80... Connected means a (web) service is listening on port 80, and you were able to connect to it.
If the site is working well when using a browser (and also from other IP address) connection reset by peer only gives you a feedback whatever you are trying to do, does not somewhat work. If you want more details, you can try to sniff the connection.
However, short of asking the owner of site for logs/debugging, I pretty much doubt you will get more data about the reasons behind it being reset otherwise.
As for the causes, it might be that they have rules to not accept your user agent/spiders/have specific pages/or configurations that trow purposefully that error or also block you after n tries/pages in a defined time frame (defined by them).
As commented before, this is more related to specific site security measures and configurations than a Unix issue per se.
For listening to the actual HTTP requests, you can also run in your machine:
# ngrep -q "." "port 80"
or
# ngrep -q "." "port 80 and host www.jdfschool.com"
Mind you that depending also on configurations, HTML, DNS and infra-structure setup, it is not a given the second ngrep will listen to all HTTP requests.
As @muru states in comments, using
wget -v http://www.jdfschool.com
also might output more useful data.
As talked before, the odds of pinpoint exactly why is happening is slim. (In Apache web servers it is common to setup mod_evasive and mod_security to curb on spiders/abusive behaviour, for instance)
TLDR From the point of view of the site owner, what is happening to your command might well be intended behaviour.
answered 2 days ago
Rui F RibeiroRui F Ribeiro
41.9k1483142
1
More verbose outputwget -vmay help to see at what stage the connection was closed, maybe. (Thanks, by the way!)
– muru
2 days ago
1
wget -vget no more logs.
– 244boy
2 days ago
add a comment |
As you correctly assume, 80... Connected means a (web) service is listening on port 80, and you were able to connect to it.
If the site is working well when using a browser (and also from other IP address) connection reset by peer only gives you a feedback whatever you are trying to do, does not somewhat work. If you want more details, you can try to sniff the connection.
However, short of asking the owner of site for logs/debugging, I pretty much doubt you will get more data about the reasons behind it being reset otherwise.
As for the causes, it might be that they have rules to not accept your user agent/spiders/have specific pages/or configurations that trow purposefully that error or also block you after n tries/pages in a defined time frame (defined by them).
As commented before, this is more related to specific site security measures and configurations than a Unix issue per se.
For listening to the actual HTTP requests, you can also run in your machine:
# ngrep -q "." "port 80"
or
# ngrep -q "." "port 80 and host www.jdfschool.com"
Mind you that depending also on configurations, HTML, DNS and infra-structure setup, it is not a given the second ngrep will listen to all HTTP requests.
As @muru states in comments, using
wget -v http://www.jdfschool.com
also might output more useful data.
As talked before, the odds of pinpoint exactly why is happening is slim. (In Apache web servers it is common to setup mod_evasive and mod_security to curb on spiders/abusive behaviour, for instance)
TLDR From the point of view of the site owner, what is happening to your command might well be intended behaviour.
answered 2 days ago
Rui F RibeiroRui F Ribeiro
41.9k1483142
As you correctly assume, 80... Connected means a (web) service is listening on port 80, and you were able to connect to it.
If the site is working well when using a browser (and also from other IP address) connection reset by peer only gives you a feedback whatever you are trying to do, does not somewhat work. If you want more details, you can try to sniff the connection.
However, short of asking the owner of site for logs/debugging, I pretty much doubt you will get more data about the reasons behind it being reset otherwise.
As for the causes, it might be that they have rules to not accept your user agent/spiders/have specific pages/or configurations that trow purposefully that error or also block you after n tries/pages in a defined time frame (defined by them).
As commented before, this is more related to specific site security measures and configurations than a Unix issue per se.
For listening to the actual HTTP requests, you can also run in your machine:
# ngrep -q "." "port 80"
or
# ngrep -q "." "port 80 and host www.jdfschool.com"
Mind you that depending also on configurations, HTML, DNS and infra-structure setup, it is not a given the second ngrep will listen to all HTTP requests.
As @muru states in comments, using
wget -v http://www.jdfschool.com
also might output more useful data.
As talked before, the odds of pinpoint exactly why is happening is slim. (In Apache web servers it is common to setup mod_evasive and mod_security to curb on spiders/abusive behaviour, for instance)
TLDR From the point of view of the site owner, what is happening to your command might well be intended behaviour.
answered 2 days ago
Rui F RibeiroRui F Ribeiro
41.9k1483142
edited 2 days ago
answered 2 days ago
Rui F RibeiroRui F Ribeiro
41.9k1483142
answered 2 days ago
Rui F RibeiroRui F Ribeiro
41.9k1483142
answered 2 days ago
Rui F RibeiroRui F Ribeiro
41.9k1483142
41.9k1483142
1
More verbose outputwget -vmay help to see at what stage the connection was closed, maybe. (Thanks, by the way!)
– muru
2 days ago
1
wget -vget no more logs.
– 244boy
2 days ago
add a comment |
1
More verbose outputwget -vmay help to see at what stage the connection was closed, maybe. (Thanks, by the way!)
– muru
2 days ago
1
wget -vget no more logs.
– 244boy
2 days ago
1
1
More verbose output
wget -v may help to see at what stage the connection was closed, maybe. (Thanks, by the way!)– muru
2 days ago
More verbose output
wget -v may help to see at what stage the connection was closed, maybe. (Thanks, by the way!)– muru
2 days ago
1
1
wget -v get no more logs.– 244boy
2 days ago
wget -v get no more logs.– 244boy
2 days ago
add a comment |
Thanks for contributing an answer to Unix & Linux Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f510412%2fhow-can-wget-get-more-logs-when-it-gets-error%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
@muru welcome back!
– Rui F Ribeiro
2 days ago