nixCraft

karabaja · #1 (**permalink**) 10-05-2006, 11:01 PM

I have a script which downloads like 10 xml files from free feed hosting site.
And script has something like this

Code:

wget http://www.feedurl.com/rss.xml
mv rss.xml filename.xml
wget http://www.feedurl.com/filename.xml
etc.

some of them are named rss.xml and I can't change that so I use mv to rename them to what I need them to be named. Some of them I don't need renaming so they are downloaded as is.

But the problem is that this feed hosting site has high loads often and outputs just error instead of the feed. And if I try to download same feed like 10 seconds later it will work sometimes.
The problem is I can't check on it all the time if it downloaded them all ok or got some errors.

So I was wondering is there a way and how. To include like error search in the script so that it searches the rss.xml or filename.xml for errors after it is downloaded and if it finds errors to repeat download with 10 seconds delay. This is part of the error that is written in files if they weren't retrieved properly:

Code:

The remote server returned an error

so I was hoping to set up something like search for the above and if found repeat

Code:

wget wget http://www.feedurl.com/rss.xml

after 10 seconds.
but I have no idea what commands would do that if possible at all.

And would the rest of the script wait for first process to finish before continuing or would I have to split each file in separate script.

Thanks in advance and thx for all helpful replies on my previous threads.

nixcraft · #2 (**permalink**) 10-06-2006, 01:36 AM

Use exit status of wget. If it is zero command is successful else failed to download rss.

Code:

wget http://someurl.com/feed/
if [ $? -ne 0 ];
 echo "Failed " 
else 
 echo "Done"
fi

May be in for loop...

Code:

#!/bin/sh
URLS="http://some.com/rss http://u.com/feed http://abc.com/atom.xml"
for u in $URLS
do
wget $u
if [ $? -ne 0 ];
 echo "$u - Failed " 
 # add more error logic 
 # try to repeat download one more time
 wget $u
else 
 echo "$u - Done"
fi
done

karabaja · #3 (**permalink**) 10-06-2006, 05:11 PM

Thx but I am not sure I understood that. The thing is that it on most feeds it will never fail downloading. But rather download file with just errors. That's because I use another site to group feeds together in one feed. And site that hosts joined feeds works fine so it just downloads a feed with errors reported for stand alone feeds that are a part of it.

sweta · #4 (**permalink**) 10-10-2006, 03:32 AM

Please post your existing script so that we can provide solution or at least give you some suggestion

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
gcc 3.4.6 rpm download	chiku	Linux software	2	05-18-2007 05:21 PM
Invalid ICMP type 3 code 3 error to a broadcast -samba error	raj	Linux software	0	07-09-2006 05:38 AM
Download with timer?	marinm	Shell scripting	6	01-23-2006 12:53 AM
Linux desktop download	rogy	Linux software	2	01-05-2006 08:06 PM

nixCraft

If error repeat the download?

If error repeat the download?

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)

Similar Threads