Go Back   Cruiser Log World Cruising & Sailing Forums > Cruising & Sailing Wiki > Cruising & Sailing Wiki Discussion
Cruiser Wiki Click Here to Login

Join Cruiser Log Today

Reply
 
Thread Tools Search this Thread Display Modes
 
Old 10-31-2014, 10:39 AM   #1
Moderator
 
delatbabel's Avatar
 
Join Date: Jul 2007
Posts: 698
Send a message via AIM to delatbabel
Default Offline version of the wiki

Hi all,

I just built an offline version of the cruising and sailing wiki.

I have uploaded it to filehosting.org and the link to download it is here:

filehosting.org | Download | cruiserswiki.zim

The file will stick around for about 3 weeks minimum, or about 20 days after the last download. It's about a 1.1GB download including all of the images, so make sure it's something you download before you go anywhere rather than trying to do so at sea.

In order to use it, you need an offline ZIM viewer, these are about for the Android and iPad type platforms. The one that I have been using is called kiwix, it gets pretty good reviews. Do a search for kiwix in the android or ipad app stores, it should be there. No doubt you'll need some kind of external storage such as a micro SD card.

I've loaded a copy on to my samsung tablet and it seems pretty good so far. There are a few formatting issues but most of the information is there just like in a web browser.

I'll try to update the offline copy at regular intervals if people find a use for it.

Del
__________________

__________________
= New South Wales, Queensland,
delatbabel is offline   Reply With Quote
Old 10-31-2014, 10:41 AM   #2
Moderator
 
delatbabel's Avatar
 
Join Date: Jul 2007
Posts: 698
Send a message via AIM to delatbabel
Default

kiwix has windows, Mac and Linux versions as well.
__________________

__________________
= New South Wales, Queensland,
delatbabel is offline   Reply With Quote
Old 10-31-2014, 08:03 PM   #3
Moderator
 
Join Date: Jun 2010
Posts: 57
Default

This is great news. Being able to access the wiki while at sea is very important.

Was the process of taking the data and getting into a zim file for kiwix easy?

1.1 GB seems awfully big the whole english language Wikipedia is available for 12 GB (without photo). I wonder how much our photos take up of that 1.1 GB? Maybe it's possible we can identify some unusually large photos and compress them without much loss?
__________________
Andy R is offline   Reply With Quote
Old 11-01-2014, 12:38 AM   #4
Moderator
 
Join Date: Jun 2010
Posts: 57
Default

One idea might be to gather a group of people and offer up the most recent version of the wiki via bittorrent. I don't know what issues we might have with that such as old copies remaining online when newer copies are available. Just an idea since it's a big file. We have some server space too but I am concerned about bandwidth with such a large file. Another idea might be a download manager so people can keep downloading where they left off in the event their connection breaks. I'd hate to try and grab such a large file on a crappy connection and keep getting a large way through and have to start over.
__________________
Andy R is offline   Reply With Quote
Old 11-01-2014, 01:03 AM   #5
Moderator
 
delatbabel's Avatar
 
Join Date: Jul 2007
Posts: 698
Send a message via AIM to delatbabel
Default

I've used ADM on android and it works quite well, there are other download managers out there. A torrent download only works if there are enough people to seed -- usually only for a file that's quite popular. Then of course to seed the torrent you need a number of people to download the file and start seeding.

In terms of creating the file -- what I ended up doing was downloading the entire wiki using some scripts, then using some more scripts that I wrote to post-process the HTML and CSS (turn the CSS file names into something more sensible for local use), and then using zimwriterfs from the kiwix project to turn that into a zim file.

I will have another go at creating the zim file but doing a bit of image compression first -- some of the JPEG and PNG images could stand to be compressed a little better. I did try making a zip file of the zim file but didn't gain much out of it. It would be easier if I had access to the server because then I could optimise the images in situ rather than downloading and then optimising.

Images are most of the size of the zim file -- on disk the images are 1.1GB and the wiki text is 250MB.
__________________
= New South Wales, Queensland,
delatbabel is offline   Reply With Quote
Old 11-01-2014, 02:39 AM   #6
Moderator
 
delatbabel's Avatar
 
Join Date: Jul 2007
Posts: 698
Send a message via AIM to delatbabel
Default

Hi all,

I created a new copy after optimising the images, which brought the file size down to about 850MB.

filehosting.org | Download | cruiserswiki.zim

I'm reluctant to do one without images -- a lot of the images are things like marina plans, pilot charts, etc, and would be useful to have even if they take up space.
__________________
= New South Wales, Queensland,
delatbabel is offline   Reply With Quote
Old 11-01-2014, 10:13 AM   #7
Admiral
 
haiqu's Avatar
 
Join Date: May 2011
Home Port: Brisbane
Vessel Name: Keppelena
Posts: 1,519
Default

Awesome idea Del.
__________________
"The cure for anything is salt water... sweat, tears, or the sea" -- Isak Dinesen

I've Contributed to the Cruisers Wiki: All sections
haiqu is offline   Reply With Quote
Old 11-03-2014, 08:55 AM   #8
Moderator
 
delatbabel's Avatar
 
Join Date: Jul 2007
Posts: 698
Send a message via AIM to delatbabel
Default

If you're after wikipedia in ZIM format to use in the same kiwix reader, this page has the links:

http://kiwix.org/wiki/Wikipedia_in_all_languages

The 3.7GB download of a selection of 45,000 articles is quite good enough for casual reading. I'd like to have the 42B download of the full wikipedia but it's a bit large to store anywhere other than a USB hard drive. Maybe when 64GB Micro SD cards come down in price a bit.
__________________

__________________
= New South Wales, Queensland,
delatbabel is offline   Reply With Quote
Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
Site offline Monday, March 17 Janet H Forum Admin, News & Announcements 2 03-25-2014 01:17 PM
Forums Will Be Offline For About One Hour - Sunday imported_admin General Cruising Forum 0 05-14-2009 09:57 PM
Text Version Of These Sailing Forums. imported_admin Forum Admin, News & Announcements 0 03-04-2007 09:18 AM

Our Communities

Our communities encompass many different hobbies and interests, but each one is built on friendly, intelligent membership.

» More about our Communities

Automotive Communities

Our Automotive communities encompass many different makes and models. From U.S. domestics to European Saloons.

» More about our Automotive Communities

RV & Travel Trailer Communities

Our RV & Travel Trailer sites encompasses virtually all types of Recreational Vehicles, from brand-specific to general RV communities.

» More about our RV Communities

Marine Communities

Our Marine websites focus on Cruising and Sailing Vessels, including forums and the largest cruising Wiki project on the web today.

» More about our Marine Communities


All times are GMT. The time now is 04:12 PM.


Powered by vBulletin® Version 3.8.8 Beta 4
Copyright ©2000 - 2017, vBulletin Solutions, Inc.
SEO by vBSEO 3.6.0