Wikipedia on Rockbox? - Page 14

Nanoman.ca · #**521** (**permalink**) September 24th, 2006, 04:50 PM

Quote:

Originally Posted by Hellworm

But bt does download only changes. Although rsync is more exact.

However the killer argument why both methods won't work is compression.
Serving the files uncompressed would be a huge waste. Compression will save bandwidth, but small changes will change the whole file.
So as long as we have no internal compression updates have to be applied manually (download some update-file and then appy the changes with an extra program).

Could rsync's -z (--compress) option solve this problem?

Hellworm · #**522** (**permalink**) September 25th, 2006, 09:33 AM

Let's use rsync

.

gursikh · #**523** (**permalink**) September 25th, 2006, 01:10 PM

This is all irrelevant until Connell releases *something* useful to the public.

tpyoboy · #**524** (**permalink**) September 25th, 2006, 08:13 PM

If my meager coding skills can be of assistance im more than willing to help out with the plugin

tpyo

wikiriver · #**525** (**permalink**) September 26th, 2006, 11:47 AM

Well, we can see if you can help with bugs - if Connell will release an alpha...

Wikiriver

connell · #**526** (**permalink**) October 10th, 2006, 07:29 AM

Hi people,

I'm reeaallly sorry that I haven't given any updates or indeed had any progress. I've just started Uni and I have _no_ time. I am willing to give another c programmer the code so far (which I think works a bit but frequently crashes and isn't suitable for alpha yet). If someone who would like to take up the challenge could PM me with their e-mail address then I will e-mail the source to them.

Regards (and sorry),
Connell

bro2baseball · #**527** (**permalink**) October 15th, 2006, 09:43 AM

I recommend making a plea on the rockbox.org forums to see if someone will continue developing this. There must be someone interested (i hope).

bro2

Llorean · #**528** (**permalink**) October 15th, 2006, 10:04 AM

You could also always post it as a patch on the Rockbox tracker in the hopes that someone will take an interest. That's the best way to get the attention of the more major developers.

wikiriver · #**529** (**permalink**) October 15th, 2006, 02:46 PM

For both of those we really need the source.

Is there a problem with posting it here, connell?

Hellworm · #**530** (**permalink**) October 16th, 2006, 07:13 AM

I'll have a look at the source, as I'm interested in continuing this project, connel if you could send me the source.

Mad_Big_Sausage · #**531** (**permalink**) October 16th, 2006, 09:11 AM

Why couldn't we get the source throughout??
The more devs the faster paced the development and the better the final outcome usually...

I know it was Connel's pet project but rb is open source.

wikiriver · #**532** (**permalink**) October 16th, 2006, 10:10 AM

I was wondering that...

afruff23 · #**533** (**permalink**) October 21st, 2006, 01:25 AM

I 3rd this; please release the source.

iwantanimac · #**534** (**permalink**) October 24th, 2006, 07:53 AM

Just a question... I read some of the wiki about syntax and stuff, why not just make it parse HTML instead? Then you'd have a double viewer - Wiki and HTM? Jsut an idea, or would it be better if someone made a jsut HTML plugin? I'd love to see some form of HTML on Rockbox... just text, or image links, so they open in the viewer plugin or something... Oh, and is there any chance this'll be ported to the H10? I'm dying to see this!

Persephonon · #**535** (**permalink**) October 24th, 2006, 01:21 PM

Hi everyone,
I've been watching this thread eagerly for a while already and really like the idea. I was wondering how long it will take (just very roughly) till the first stable build might be released and if I will be able to run it on a ipod (nano) with rockbox as well.
Thank you guys a lot!

wikiriver · #**536** (**permalink**) October 25th, 2006, 02:05 AM

Quote:

Originally Posted by iwantanimac

Just a question... I read some of the wiki about syntax and stuff, why not just make it parse HTML instead? Then you'd have a double viewer - Wiki and HTM? Jsut an idea, or would it be better if someone made a jsut HTML plugin? I'd love to see some form of HTML on Rockbox... just text, or image links, so they open in the viewer plugin or something...

The reason, IIRC was that HTML would mean larger file sizes as it requires multiple characters for each tag. If you look at the page in the wiki, it's best to have a converter and a file format just for the player.

Also, images would bring another problem with file size.

wikiriver · #**537** (**permalink**) October 25th, 2006, 03:40 AM

Quote:

Originally Posted by Persephonon

Hi everyone,
I've been watching this thread eagerly for a while already and really like the idea. I was wondering how long it will take (just very roughly) till the first stable build might be released and if I will be able to run it on a ipod (nano) with rockbox as well.
Thank you guys a lot!

Yes, you should hopefully be able to run it on an ipod eventually. iwantanimac should also hopefully be able to run it on the H10.

It's still a bit early for estimated release dates as our plugin programmer has left the project due to a high workload at Uni.

HTH.

bro2baseball · #**538** (**permalink**) October 28th, 2006, 09:28 PM

from rockbox flyspray http://www.rockbox.org/tracker/task/4755

Quote:

Comment by Frederik (freqmod) - Friday, 27 October 2006, 12:23AM
I have created a plugin to search out wikipedia articles, it takes about 5 seconds to search for an article (exact match) on an i-pod and uses b-trees for an index and gzip compression for the articles. (about 2.5GB, split into 1GB files for english retrieved wikipedia a week ago).

I will release the source soon (before 5.nov) when it is a little more finished.

this is for ipods, however it SHOULD be able to be ported relatively easily.

bro2

wikiriver · #**539** (**permalink**) October 29th, 2006, 03:46 AM

Quote:

Originally Posted by bro2baseball

from rockbox flyspray http://www.rockbox.org/tracker/task/4755

this is for ipods, however it SHOULD be able to be ported relatively easily.

bro2

Yeah, I saw that, but we already have another plugin which has been written and almost completed.

So I'm really waiting in anticipation for that.

But thanks anyway.

freqmod_no · #**540** (**permalink**) November 4th, 2006, 03:00 PM

(uploaded on flyspray) Please note that the plugin only does the following:

On host:
* Parses the wikimedia xml dumps
* Gzips the article sources
* Handles redirects
* Makes an index

On rockbox:
* Searches in the index
* Decompresses the text into a memory buffer

* (implements a simple text viewer which only supports scrolling, should be reimplemented)

* separates the search code, with the api

Code:

/*Returns status*/
int mwdb_getarticle(const char* filename, (/* filename without extention*/
                    char* artnme, /*Article name*/
                    uint16_t artnmelen, /*length of the article name buffer*/
                    void* scratchmem,/*0x13100 bytes decompression scratch memory*/
                    void *articlemem,/* <variable sized> memory for the decompressed article*/
                    uint32_t articlemenlen /*length of the articlemem buffer*/,
                    uint32_t *articlelen, /*pointer to int to put the length of the article*/
                    bool progress, /*display progress?*/
                    bool promptname /*Prompt for articlename?*/
                   );

tpyoboy · #**541** (**permalink**) November 5th, 2006, 04:30 AM

Sounds great freqmod! and thanks for the update. Really nice to hear some progress being made again in this area..

Tpyo

bro2baseball · #**542** (**permalink**) November 5th, 2006, 09:59 AM

Has anyone actually been able to contact Conell and get the source?

tpyoboy · #**543** (**permalink**) November 5th, 2006, 02:46 PM

I am guessing no, or someone would have said something.

typo

wikiriver · #**544** (**permalink**) November 6th, 2006, 12:54 PM

I PMmed him yesterday, but have had no response as yet.