Download ALL files from Website with directory listing











up vote
1
down vote

favorite












I know that it's possible but I'm having problem when I want to enter the folder with 'index.html / index.php', it automatically redirects me to the site, instead of opening the folder. You can test it here.



http://svamservices.com.au/truck/ (archived version)
And try entering the main folder.



I would like to get the contest of the main folder. Any idea? I tried with wGet but it just skips the main folder.






download http website wget







share|improve this question




















  • 1




    It's by design. Otherwise wget http://<bigcompany/ would mean you could read a lot of data you're not supposed to read.
    – Seth
    Feb 3 '17 at 13:10















up vote
1
down vote

favorite












I know that it's possible but I'm having problem when I want to enter the folder with 'index.html / index.php', it automatically redirects me to the site, instead of opening the folder. You can test it here.



http://svamservices.com.au/truck/ (archived version)
And try entering the main folder.



I would like to get the contest of the main folder. Any idea? I tried with wGet but it just skips the main folder.






download http website wget







share|improve this question




















  • 1




    It's by design. Otherwise wget http://<bigcompany/ would mean you could read a lot of data you're not supposed to read.
    – Seth
    Feb 3 '17 at 13:10













up vote
1
down vote

favorite









up vote
1
down vote

favorite











I know that it's possible but I'm having problem when I want to enter the folder with 'index.html / index.php', it automatically redirects me to the site, instead of opening the folder. You can test it here.



http://svamservices.com.au/truck/ (archived version)
And try entering the main folder.



I would like to get the contest of the main folder. Any idea? I tried with wGet but it just skips the main folder.






download http website wget







share|improve this question















I know that it's possible but I'm having problem when I want to enter the folder with 'index.html / index.php', it automatically redirects me to the site, instead of opening the folder. You can test it here.



http://svamservices.com.au/truck/ (archived version)
And try entering the main folder.



I would like to get the contest of the main folder. Any idea? I tried with wGet but it just skips the main folder.






download http website wget




download http website wget






share|improve this question















share|improve this question













share|improve this question




share|improve this question








edited Nov 30 at 23:58









johan456789

34




34










asked Feb 3 '17 at 12:01









masterfan

1113




1113








  • 1




    It's by design. Otherwise wget http://<bigcompany/ would mean you could read a lot of data you're not supposed to read.
    – Seth
    Feb 3 '17 at 13:10














  • 1




    It's by design. Otherwise wget http://<bigcompany/ would mean you could read a lot of data you're not supposed to read.
    – Seth
    Feb 3 '17 at 13:10








1




1




It's by design. Otherwise wget http://<bigcompany/ would mean you could read a lot of data you're not supposed to read.
– Seth
Feb 3 '17 at 13:10




It's by design. Otherwise wget http://<bigcompany/ would mean you could read a lot of data you're not supposed to read.
– Seth
Feb 3 '17 at 13:10










2 Answers
2






active

oldest

votes

















up vote
1
down vote













When you running following script (creating mirror of a site using wget):



#!/bin/sh



wget --mirror           

     --convert-links    

     --adjust-extension 

     --page-requisites  

     --no-parent        

http://svamservices.com.au/truck/


it will give you content that was produced by a web server. If web server allows directory listing then it will return your list of files and directories, otherwise it will execute index.php on its side and return you result of this execution (logic inside of index.php).






share|improve this answer























  • If you give that link a shot you'll see that the "redirection" is merly the delivery of whatever index file is configured. As long as there is no strange configuration to not deliver the index for wget this isn't really going to help in this case.
    – Seth
    Feb 3 '17 at 12:55










  • Ohh, you right, I thought that OP wanted content produced by index.php, but as I can see it now he wants listing of files
    – Alex
    Feb 3 '17 at 13:07










  • @Seth I edited my answer to reflect OP question. Tnx for catching my error
    – Alex
    Feb 3 '17 at 13:15


















up vote
0
down vote













This is due to the configuration of the webserver which will return a website if there is an index.php file in the folder. If this file is missing then the webserver is falling back to directory listing but as the primary action is to show a website if it can, it is not normally possible for end users to get directory listings under those circumstances.






share|improve this answer





















  • Can you edit your answer, so you specifically call out the configuration file, and specifcally indicate what edits should be done? People like myself might know what to do, but many, do not.
    – Ramhound
    Feb 3 '17 at 14:58










  • I note that the site is running on LightSpeed webserver. I would not say I was sufficiently adept with this server to comment on the perfect method to make this change. I note that it is supposedly Apache compatible but I'd rather not add information I cant verify. I can add for Apache and Nginx if you feel this is still of value?
    – Andy
    Feb 8 '17 at 13:32











Your Answer








StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "3"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});

function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});


}
});














draft saved

draft discarded


















StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fsuperuser.com%2fquestions%2f1174812%2fdownload-all-files-from-website-with-directory-listing%23new-answer', 'question_page');
}
);

Post as a guest















Required, but never shown

























2 Answers
2






active

oldest

votes








2 Answers
2






active

oldest

votes









active

oldest

votes






active

oldest

votes








up vote
1
down vote













When you running following script (creating mirror of a site using wget):



#!/bin/sh



wget --mirror           

     --convert-links    

     --adjust-extension 

     --page-requisites  

     --no-parent        

http://svamservices.com.au/truck/


it will give you content that was produced by a web server. If web server allows directory listing then it will return your list of files and directories, otherwise it will execute index.php on its side and return you result of this execution (logic inside of index.php).






share|improve this answer























  • If you give that link a shot you'll see that the "redirection" is merly the delivery of whatever index file is configured. As long as there is no strange configuration to not deliver the index for wget this isn't really going to help in this case.
    – Seth
    Feb 3 '17 at 12:55










  • Ohh, you right, I thought that OP wanted content produced by index.php, but as I can see it now he wants listing of files
    – Alex
    Feb 3 '17 at 13:07










  • @Seth I edited my answer to reflect OP question. Tnx for catching my error
    – Alex
    Feb 3 '17 at 13:15















up vote
1
down vote













When you running following script (creating mirror of a site using wget):



#!/bin/sh



wget --mirror           

     --convert-links    

     --adjust-extension 

     --page-requisites  

     --no-parent        

http://svamservices.com.au/truck/


it will give you content that was produced by a web server. If web server allows directory listing then it will return your list of files and directories, otherwise it will execute index.php on its side and return you result of this execution (logic inside of index.php).






share|improve this answer























  • If you give that link a shot you'll see that the "redirection" is merly the delivery of whatever index file is configured. As long as there is no strange configuration to not deliver the index for wget this isn't really going to help in this case.
    – Seth
    Feb 3 '17 at 12:55










  • Ohh, you right, I thought that OP wanted content produced by index.php, but as I can see it now he wants listing of files
    – Alex
    Feb 3 '17 at 13:07










  • @Seth I edited my answer to reflect OP question. Tnx for catching my error
    – Alex
    Feb 3 '17 at 13:15













up vote
1
down vote










up vote
1
down vote









When you running following script (creating mirror of a site using wget):



#!/bin/sh



wget --mirror           

     --convert-links    

     --adjust-extension 

     --page-requisites  

     --no-parent        

http://svamservices.com.au/truck/


it will give you content that was produced by a web server. If web server allows directory listing then it will return your list of files and directories, otherwise it will execute index.php on its side and return you result of this execution (logic inside of index.php).






share|improve this answer














When you running following script (creating mirror of a site using wget):



#!/bin/sh



wget --mirror           

     --convert-links    

     --adjust-extension 

     --page-requisites  

     --no-parent        

http://svamservices.com.au/truck/


it will give you content that was produced by a web server. If web server allows directory listing then it will return your list of files and directories, otherwise it will execute index.php on its side and return you result of this execution (logic inside of index.php).







share|improve this answer














share|improve this answer



share|improve this answer








edited Feb 3 '17 at 13:13

























answered Feb 3 '17 at 12:11









Alex

5,33111019




5,33111019












  • If you give that link a shot you'll see that the "redirection" is merly the delivery of whatever index file is configured. As long as there is no strange configuration to not deliver the index for wget this isn't really going to help in this case.
    – Seth
    Feb 3 '17 at 12:55










  • Ohh, you right, I thought that OP wanted content produced by index.php, but as I can see it now he wants listing of files
    – Alex
    Feb 3 '17 at 13:07










  • @Seth I edited my answer to reflect OP question. Tnx for catching my error
    – Alex
    Feb 3 '17 at 13:15


















  • If you give that link a shot you'll see that the "redirection" is merly the delivery of whatever index file is configured. As long as there is no strange configuration to not deliver the index for wget this isn't really going to help in this case.
    – Seth
    Feb 3 '17 at 12:55










  • Ohh, you right, I thought that OP wanted content produced by index.php, but as I can see it now he wants listing of files
    – Alex
    Feb 3 '17 at 13:07










  • @Seth I edited my answer to reflect OP question. Tnx for catching my error
    – Alex
    Feb 3 '17 at 13:15
















If you give that link a shot you'll see that the "redirection" is merly the delivery of whatever index file is configured. As long as there is no strange configuration to not deliver the index for wget this isn't really going to help in this case.
– Seth
Feb 3 '17 at 12:55




If you give that link a shot you'll see that the "redirection" is merly the delivery of whatever index file is configured. As long as there is no strange configuration to not deliver the index for wget this isn't really going to help in this case.
– Seth
Feb 3 '17 at 12:55












Ohh, you right, I thought that OP wanted content produced by index.php, but as I can see it now he wants listing of files
– Alex
Feb 3 '17 at 13:07




Ohh, you right, I thought that OP wanted content produced by index.php, but as I can see it now he wants listing of files
– Alex
Feb 3 '17 at 13:07












@Seth I edited my answer to reflect OP question. Tnx for catching my error
– Alex
Feb 3 '17 at 13:15




@Seth I edited my answer to reflect OP question. Tnx for catching my error
– Alex
Feb 3 '17 at 13:15












up vote
0
down vote













This is due to the configuration of the webserver which will return a website if there is an index.php file in the folder. If this file is missing then the webserver is falling back to directory listing but as the primary action is to show a website if it can, it is not normally possible for end users to get directory listings under those circumstances.






share|improve this answer





















  • Can you edit your answer, so you specifically call out the configuration file, and specifcally indicate what edits should be done? People like myself might know what to do, but many, do not.
    – Ramhound
    Feb 3 '17 at 14:58










  • I note that the site is running on LightSpeed webserver. I would not say I was sufficiently adept with this server to comment on the perfect method to make this change. I note that it is supposedly Apache compatible but I'd rather not add information I cant verify. I can add for Apache and Nginx if you feel this is still of value?
    – Andy
    Feb 8 '17 at 13:32















up vote
0
down vote













This is due to the configuration of the webserver which will return a website if there is an index.php file in the folder. If this file is missing then the webserver is falling back to directory listing but as the primary action is to show a website if it can, it is not normally possible for end users to get directory listings under those circumstances.






share|improve this answer





















  • Can you edit your answer, so you specifically call out the configuration file, and specifcally indicate what edits should be done? People like myself might know what to do, but many, do not.
    – Ramhound
    Feb 3 '17 at 14:58










  • I note that the site is running on LightSpeed webserver. I would not say I was sufficiently adept with this server to comment on the perfect method to make this change. I note that it is supposedly Apache compatible but I'd rather not add information I cant verify. I can add for Apache and Nginx if you feel this is still of value?
    – Andy
    Feb 8 '17 at 13:32













up vote
0
down vote










up vote
0
down vote









This is due to the configuration of the webserver which will return a website if there is an index.php file in the folder. If this file is missing then the webserver is falling back to directory listing but as the primary action is to show a website if it can, it is not normally possible for end users to get directory listings under those circumstances.






share|improve this answer












This is due to the configuration of the webserver which will return a website if there is an index.php file in the folder. If this file is missing then the webserver is falling back to directory listing but as the primary action is to show a website if it can, it is not normally possible for end users to get directory listings under those circumstances.







share|improve this answer












share|improve this answer



share|improve this answer










answered Feb 3 '17 at 12:10









Andy

64649




64649












  • Can you edit your answer, so you specifically call out the configuration file, and specifcally indicate what edits should be done? People like myself might know what to do, but many, do not.
    – Ramhound
    Feb 3 '17 at 14:58










  • I note that the site is running on LightSpeed webserver. I would not say I was sufficiently adept with this server to comment on the perfect method to make this change. I note that it is supposedly Apache compatible but I'd rather not add information I cant verify. I can add for Apache and Nginx if you feel this is still of value?
    – Andy
    Feb 8 '17 at 13:32


















  • Can you edit your answer, so you specifically call out the configuration file, and specifcally indicate what edits should be done? People like myself might know what to do, but many, do not.
    – Ramhound
    Feb 3 '17 at 14:58










  • I note that the site is running on LightSpeed webserver. I would not say I was sufficiently adept with this server to comment on the perfect method to make this change. I note that it is supposedly Apache compatible but I'd rather not add information I cant verify. I can add for Apache and Nginx if you feel this is still of value?
    – Andy
    Feb 8 '17 at 13:32
















Can you edit your answer, so you specifically call out the configuration file, and specifcally indicate what edits should be done? People like myself might know what to do, but many, do not.
– Ramhound
Feb 3 '17 at 14:58




Can you edit your answer, so you specifically call out the configuration file, and specifcally indicate what edits should be done? People like myself might know what to do, but many, do not.
– Ramhound
Feb 3 '17 at 14:58












I note that the site is running on LightSpeed webserver. I would not say I was sufficiently adept with this server to comment on the perfect method to make this change. I note that it is supposedly Apache compatible but I'd rather not add information I cant verify. I can add for Apache and Nginx if you feel this is still of value?
– Andy
Feb 8 '17 at 13:32




I note that the site is running on LightSpeed webserver. I would not say I was sufficiently adept with this server to comment on the perfect method to make this change. I note that it is supposedly Apache compatible but I'd rather not add information I cant verify. I can add for Apache and Nginx if you feel this is still of value?
– Andy
Feb 8 '17 at 13:32


















draft saved

draft discarded




















































Thanks for contributing an answer to Super User!


  • Please be sure to answer the question. Provide details and share your research!

But avoid …



  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.


To learn more, see our tips on writing great answers.





Some of your past answers have not been well-received, and you're in danger of being blocked from answering.


Please pay close attention to the following guidance:


  • Please be sure to answer the question. Provide details and share your research!

But avoid …



  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.


To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fsuperuser.com%2fquestions%2f1174812%2fdownload-all-files-from-website-with-directory-listing%23new-answer', 'question_page');
}
);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







-

Popular posts from this blog

Mouse cursor on multiple screens with different PPI

Image
24 6 I'm using a 4K display along with a Full HD display with both almost the same physical size and it brings some mouse cursor problems to me working with it on the default Windows settings. As the mouse movement speed depends on the pixels, it's very slow on the 4K display and very fast on the Full HD display. Is there a windows setting or application to move the mouse depending on the visible distance and not the pixels? Another problem is the virtual wall between the screens I can't move the cursor from the upper half of the 4K screen to the Full HD screen: How is it possible to virtually stretch the cursor transition area of the Full HD screen to the one of the 4K monitor? The smallest problem, nevertheless painful, is the cursor size which varies between the screens. Is there a way ...
Read more

Agildo Ribeiro

Image
Agildo Ribeiro Agildo em 2015 Nome completo Agildo da Gama Barata Ribeiro Filho Nascimento 26 de abril de 1932 Rio de Janeiro, DF Morte 28 de abril de 2018 (86 anos) Rio de Janeiro, RJ Ocupação Ator e humorista ...
Read more

Sometime when accessing a menu: “Ubuntu 16.04 has experienced an internal error”

Image
0 Sometime, when I try to access some menu (may be inside an application or desktop, doesn't matter), I got the following error. The menu and submenu disappear for a while. After that, I can continue using the system. And the lspci gave me the following output: $ lspci -k | grep -EA3 'VGA|3D|Display' 00:02.0 VGA compatible controller: Intel Corporation Haswell-ULT Integrated Graphics Controller (rev 0b) DeviceName: Onboard IGD Subsystem: Dell Haswell-ULT Integrated Graphics Controller Kernel driver in use: i915 unity compiz error-handling share | improve this question edited Mar 5 at 16:09 ...
Read more