How to update a local mirror from a public server?Rsync from remote server to local computer with no public IPRsyncing files from server to local machine automaticallyRun LFTP on a list of filesHow to copy files from one remote server to another (LFTP)Rsync only new files from a remote serverUnix command to copy file from remote server to a terminal shellDoes rsync require both source host and destination host to run rsync as client, server, or daemon?lftp logging of removed source filesContinue a download if timestamp has not changedConvenient way to update a local folder from a remote one when using LXDECan't use LFTP with SFTP but SFTP clients allow connections

How is the claim "I am in New York only if I am in America" the same as "If I am in New York, then I am in America?

Why can't we play rap on piano?

Are the number of citations and number of published articles the most important criteria for a tenure promotion?

Was any UN Security Council vote triple-vetoed?

How much RAM could one put in a typical 80386 setup?

What does it mean to describe someone as a butt steak?

Why do I get two different answers for this counting problem?

A newer friend of my brother's gave him a load of baseball cards that are supposedly extremely valuable. Is this a scam?

How does one intimidate enemies without having the capacity for violence?

Did Shadowfax go to Valinor?

Why is consensus so controversial in Britain?

Maximum likelihood parameters deviate from posterior distributions

Important Resources for Dark Age Civilizations?

Paid for article while in US on F-1 visa?

Horror movie about a virus at the prom; beginning and end are stylized as a cartoon

Today is the Center

Is it possible to do 50 km distance without any previous training?

Are astronomers waiting to see something in an image from a gravitational lens that they've already seen in an adjacent image?

Malformed Address '10.10.21.08/24', must be X.X.X.X/NN or

Why is 150k or 200k jobs considered good when there's 300k+ births a month?

Is it unprofessional to ask if a job posting on GlassDoor is real?

Client team has low performances and low technical skills: we always fix their work and now they stop collaborate with us. How to solve?

Why can't I see bouncing of switch on oscilloscope screen?

Replacing matching entries in one column of a file by another column from a different file



How to update a local mirror from a public server?


Rsync from remote server to local computer with no public IPRsyncing files from server to local machine automaticallyRun LFTP on a list of filesHow to copy files from one remote server to another (LFTP)Rsync only new files from a remote serverUnix command to copy file from remote server to a terminal shellDoes rsync require both source host and destination host to run rsync as client, server, or daemon?lftp logging of removed source filesContinue a download if timestamp has not changedConvenient way to update a local folder from a remote one when using LXDECan't use LFTP with SFTP but SFTP clients allow connections






.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;








1















I already have a mirror of the entire slackware64-current/ directory tree using




wget -r -np -R "index.html*" https://mirror.slackbuilds.org/slackware/slackware64-current/




and that's fine. But it's getting a bit old, and I'd like to update just the changed files. rsync would work great, but I don't have an ssh username@... for that mirror.slackbuilds.org/ site. Is there any way to rsync publicly-accessible files from a remote server without a username@?



Alternatively, I've browsed the manpages for lftp and wget, but am not seeing exactly how to construct the appropriate commands. It seems like lftp would do the trick if I could figure out exactly how, but the manpage isn't entirely clear (to me).



So what, and exactly how, is the best way to sync up a local directory tree from a publicly accessible remote server (without any ssh username or other privileges)? It looks like Rsync from remote server to local computer with no public IP is asking basically the same question, but not getting a suitable answer (at least not for my purposes). And, by the way, it would be great to also have an rsync  -n type of option, so that I could see what needed updating before actually updating it.










share|improve this question




























    1















    I already have a mirror of the entire slackware64-current/ directory tree using




    wget -r -np -R "index.html*" https://mirror.slackbuilds.org/slackware/slackware64-current/




    and that's fine. But it's getting a bit old, and I'd like to update just the changed files. rsync would work great, but I don't have an ssh username@... for that mirror.slackbuilds.org/ site. Is there any way to rsync publicly-accessible files from a remote server without a username@?



    Alternatively, I've browsed the manpages for lftp and wget, but am not seeing exactly how to construct the appropriate commands. It seems like lftp would do the trick if I could figure out exactly how, but the manpage isn't entirely clear (to me).



    So what, and exactly how, is the best way to sync up a local directory tree from a publicly accessible remote server (without any ssh username or other privileges)? It looks like Rsync from remote server to local computer with no public IP is asking basically the same question, but not getting a suitable answer (at least not for my purposes). And, by the way, it would be great to also have an rsync  -n type of option, so that I could see what needed updating before actually updating it.










    share|improve this question
























      1












      1








      1








      I already have a mirror of the entire slackware64-current/ directory tree using




      wget -r -np -R "index.html*" https://mirror.slackbuilds.org/slackware/slackware64-current/




      and that's fine. But it's getting a bit old, and I'd like to update just the changed files. rsync would work great, but I don't have an ssh username@... for that mirror.slackbuilds.org/ site. Is there any way to rsync publicly-accessible files from a remote server without a username@?



      Alternatively, I've browsed the manpages for lftp and wget, but am not seeing exactly how to construct the appropriate commands. It seems like lftp would do the trick if I could figure out exactly how, but the manpage isn't entirely clear (to me).



      So what, and exactly how, is the best way to sync up a local directory tree from a publicly accessible remote server (without any ssh username or other privileges)? It looks like Rsync from remote server to local computer with no public IP is asking basically the same question, but not getting a suitable answer (at least not for my purposes). And, by the way, it would be great to also have an rsync  -n type of option, so that I could see what needed updating before actually updating it.










      share|improve this question














      I already have a mirror of the entire slackware64-current/ directory tree using




      wget -r -np -R "index.html*" https://mirror.slackbuilds.org/slackware/slackware64-current/




      and that's fine. But it's getting a bit old, and I'd like to update just the changed files. rsync would work great, but I don't have an ssh username@... for that mirror.slackbuilds.org/ site. Is there any way to rsync publicly-accessible files from a remote server without a username@?



      Alternatively, I've browsed the manpages for lftp and wget, but am not seeing exactly how to construct the appropriate commands. It seems like lftp would do the trick if I could figure out exactly how, but the manpage isn't entirely clear (to me).



      So what, and exactly how, is the best way to sync up a local directory tree from a publicly accessible remote server (without any ssh username or other privileges)? It looks like Rsync from remote server to local computer with no public IP is asking basically the same question, but not getting a suitable answer (at least not for my purposes). And, by the way, it would be great to also have an rsync  -n type of option, so that I could see what needed updating before actually updating it.







      rsync wget slackware software-updates lftp






      share|improve this question













      share|improve this question











      share|improve this question




      share|improve this question










      asked 2 days ago









      John ForkoshJohn Forkosh

      1208




      1208




















          1 Answer
          1






          active

          oldest

          votes


















          3














          You're looking for the -N flag to wget:




          Wget will ask the server for the last-modified date. If the local file has the same timestamp as the server, or a newer one, the remote file will not be re-fetched. However, if the remote file is more recent, Wget will proceed to fetch it.




          more info






          share|improve this answer























            Your Answer








            StackExchange.ready(function()
            var channelOptions =
            tags: "".split(" "),
            id: "106"
            ;
            initTagRenderer("".split(" "), "".split(" "), channelOptions);

            StackExchange.using("externalEditor", function()
            // Have to fire editor after snippets, if snippets enabled
            if (StackExchange.settings.snippets.snippetsEnabled)
            StackExchange.using("snippets", function()
            createEditor();
            );

            else
            createEditor();

            );

            function createEditor()
            StackExchange.prepareEditor(
            heartbeatType: 'answer',
            autoActivateHeartbeat: false,
            convertImagesToLinks: false,
            noModals: true,
            showLowRepImageUploadWarning: true,
            reputationToPostImages: null,
            bindNavPrevention: true,
            postfix: "",
            imageUploader:
            brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
            contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
            allowUrls: true
            ,
            onDemand: true,
            discardSelector: ".discard-answer"
            ,immediatelyShowMarkdownHelp:true
            );



            );













            draft saved

            draft discarded


















            StackExchange.ready(
            function ()
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f510246%2fhow-to-update-a-local-mirror-from-a-public-server%23new-answer', 'question_page');

            );

            Post as a guest















            Required, but never shown

























            1 Answer
            1






            active

            oldest

            votes








            1 Answer
            1






            active

            oldest

            votes









            active

            oldest

            votes






            active

            oldest

            votes









            3














            You're looking for the -N flag to wget:




            Wget will ask the server for the last-modified date. If the local file has the same timestamp as the server, or a newer one, the remote file will not be re-fetched. However, if the remote file is more recent, Wget will proceed to fetch it.




            more info






            share|improve this answer



























              3














              You're looking for the -N flag to wget:




              Wget will ask the server for the last-modified date. If the local file has the same timestamp as the server, or a newer one, the remote file will not be re-fetched. However, if the remote file is more recent, Wget will proceed to fetch it.




              more info






              share|improve this answer

























                3












                3








                3







                You're looking for the -N flag to wget:




                Wget will ask the server for the last-modified date. If the local file has the same timestamp as the server, or a newer one, the remote file will not be re-fetched. However, if the remote file is more recent, Wget will proceed to fetch it.




                more info






                share|improve this answer













                You're looking for the -N flag to wget:




                Wget will ask the server for the last-modified date. If the local file has the same timestamp as the server, or a newer one, the remote file will not be re-fetched. However, if the remote file is more recent, Wget will proceed to fetch it.




                more info







                share|improve this answer












                share|improve this answer



                share|improve this answer










                answered 2 days ago









                Entropy0Entropy0

                1564




                1564



























                    draft saved

                    draft discarded
















































                    Thanks for contributing an answer to Unix & Linux Stack Exchange!


                    • Please be sure to answer the question. Provide details and share your research!

                    But avoid


                    • Asking for help, clarification, or responding to other answers.

                    • Making statements based on opinion; back them up with references or personal experience.

                    To learn more, see our tips on writing great answers.




                    draft saved


                    draft discarded














                    StackExchange.ready(
                    function ()
                    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f510246%2fhow-to-update-a-local-mirror-from-a-public-server%23new-answer', 'question_page');

                    );

                    Post as a guest















                    Required, but never shown





















































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown

































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown







                    Popular posts from this blog

                    getting Checkpoint VPN SSL Network Extender working in the command lineHow to connect to CheckPoint VPN on Ubuntu 18.04LTS?Will the Linux ( red-hat ) Open VPNC Client connect to checkpoint or nortel VPN gateways?VPN client for linux machine + support checkpoint gatewayVPN SSL Network Extender in FirefoxLinux Checkpoint SNX tool configuration issuesCheck Point - Connect under Linux - snx + OTPSNX VPN Ububuntu 18.XXUsing Checkpoint VPN SSL Network Extender CLI with certificateVPN with network manager (nm-applet) is not workingWill the Linux ( red-hat ) Open VPNC Client connect to checkpoint or nortel VPN gateways?VPN client for linux machine + support checkpoint gatewayImport VPN config files to NetworkManager from command lineTrouble connecting to VPN using network-manager, while command line worksStart a VPN connection with PPTP protocol on command linestarting a docker service daemon breaks the vpn networkCan't connect to vpn with Network-managerVPN SSL Network Extender in FirefoxUsing Checkpoint VPN SSL Network Extender CLI with certificate

                    Cannot Extend partition with GParted The 2019 Stack Overflow Developer Survey Results Are In Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern) 2019 Community Moderator Election ResultsCan't increase partition size with GParted?GParted doesn't recognize the unallocated space after my current partitionWhat is the best way to add unallocated space located before to Ubuntu 12.04 partition with GParted live?I can't figure out how to extend my Arch home partition into free spaceGparted Linux Mint 18.1 issueTrying to extend but swap partition is showing as Unknown in Gparted, shows proper from fdiskRearrange partitions in gparted to extend a partitionUnable to extend partition even though unallocated space is next to it using GPartedAllocate free space to root partitiongparted: how to merge unallocated space with a partition

                    NetworkManager fails with “Could not find source connection”Trouble connecting to VPN using network-manager, while command line worksHow can I be notified about state changes to a VPN adapterBacktrack 5 R3 - Refuses to connect to VPNFeed all traffic through OpenVPN for a specific network namespace onlyRun daemon on startup in Debian once openvpn connection establishedpfsense tcp connection between openvpn and lan is brokenInternet connection problem with web browsers onlyWhy does NetworkManager explicitly support tun/tap devices?Browser issues with VPNTwo IP addresses assigned to the same network card - OpenVPN issues?Cannot connect to WiFi with nmcli, although secrets are provided