opencaching.com Forum Index opencaching.com
Geocaching by the community, for the community
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

general structure of the OpenCaching-NetWork

 
Post new topic   Reply to topic    opencaching.com Forum Index -> Issues, decisions, answers
View previous topic :: View next topic  
Author Message
Team BMW-Biker



Joined: 01 Oct 2003
Posts: 209

PostPosted: Fri Oct 03, 2003 4:45 am    Post subject: general structure of the OpenCaching-NetWork Reply with quote

Hello everybody,

i think we must first decide, how the structure must look like.

Here is my idea:
http://www.dietz.homeip.net/geocache/opencaching/ideas001/generalstructure.htm

Please post your ideas here and i will make a new mind-map.
We can discuse about all ... please do it.

I will post in a few time an idea for a replication-circle and an idea for the server-user-areas ...

Thanks for reading and discusing.
Oli from the Team BMW-Biker
Back to top
View user's profile Send private message Visit poster's website
Team BMW-Biker



Joined: 01 Oct 2003
Posts: 209

PostPosted: Fri Oct 03, 2003 6:04 am    Post subject: general structure of the OpenCaching-NetWork Reply with quote

ok, here are the other "first-ideas":
http://www.dietz.homeip.net/geocache/opencaching/ideas001/replicationcircle.htm
and
http://www.dietz.homeip.net/geocache/opencaching/ideas001/serveruserareas.htm

Happy braining, Oli[/url]
Back to top
View user's profile Send private message Visit poster's website
Team BMW-Biker



Joined: 01 Oct 2003
Posts: 209

PostPosted: Fri Oct 03, 2003 10:33 am    Post subject: XML and HTTP - Database-Structure and Replication-Protokoll Reply with quote

Hello again,

here are some more ideas

... about Database-Structure:
http://www.dietz.homeip.net/geocache/opencaching/ideas001/databasestructure.htm
... about a Replication Protokoll:
http://www.dietz.homeip.net/geocache/opencaching/ideas001/replicationprotokol.htm


... Oli
Back to top
View user's profile Send private message Visit poster's website
Vinnie



Joined: 23 Sep 2003
Posts: 71
Location: Cologne, Germany

PostPosted: Fri Oct 03, 2003 1:56 pm    Post subject: Reply with quote

Hi Oli,
great (and useful) work!

Some remarks from here:

1. I do not like these ugly guids. I prefer "readable" guids. For the caches I proposed something consisting of coordinates and time in another thread.

2. Concerning the general structure and replication: (You probably know) my proposal is to use a usenet-like network based on NNTP as "data backbone". In my opinion this solves many many problems in data distribution and replication and that we should not reinvent the wheel. But that has been discussed over and over already. We (Raven and me) have just setup a 2-node NNTP network and we have started exploring the whole thing. Reports will follow Smile

3. Our XML should be an extension of the gc.com extended GPX format, such that all software built for gc.com-GPX will accept our data as well. You may look for further ideas on XML elements in another thread where this issue was discussed and in the Navicache DTD.
Legal issues (concerning the gc.com-GPX) have been discussed, but I am very convinced that this can be no problem
Back to top
View user's profile Send private message Send e-mail
Team BMW-Biker



Joined: 01 Oct 2003
Posts: 209

PostPosted: Fri Oct 03, 2003 2:20 pm    Post subject: Reply with quote

Hi Vinnie,

Quote:
great (and useful) work!

thanks a lot Embarassed

Quote:
3. Our XML should be an extension of the gc.com extended GPX format, such that all software built for gc.com-GPX will accept our data as well. You may look for further ideas on XML elements in another thread where this issue was discussed and in the Navicache DTD.
Legal issues (concerning the gc.com-GPX) have been discussed, but I am very convinced that this can be no problem

oh yes, my ideas are just ideas ... if the GPX-Format can handle our informations (i must first read me "in it") we will use it !

Point 1 and 2:
I must first read this threads again ... there are a lot of questions - i will post them on the thread for this things ...

BTW: is there any way to read this forum with a NNTP-Client (i hate some web-interfaces Wink ?)


ok, local time is 9:20 p.m. a good time to shut off ...

... Oli
Back to top
View user's profile Send private message Visit poster's website
Team BMW-Biker



Joined: 01 Oct 2003
Posts: 209

PostPosted: Fri Oct 03, 2003 4:49 pm    Post subject: Reply with quote

Hi,

I've take some changes ...
http://www.dietz.homeip.net/geocache/opencaching/ideas002/changes.htm

... Oli
Back to top
View user's profile Send private message Visit poster's website
raven



Joined: 29 Sep 2003
Posts: 84
Location: Bielefeld, Germany

PostPosted: Sat Oct 04, 2003 3:23 pm    Post subject: Reply with quote

yep, thats a really useful ressource you built there.
here's the point in which i differ from your ideas, or maybe just don't understand them clearly ;)

- full nodes vs. regional servers
your system uses "server-user-areas", where each server/node is the "owner" of the data from users from his geographical area. i imagine a system where the data is totally the same on all nodes and no node is the "owner" of some data this has several reasons:
- it's failsafe, if one node goes down for whatever reasons, the users can instantly switch to another node and still have all their caches, logs etc. available to them. ok, i looked a bit closer at your proposal and saw that you also want to do a full replication. but if all data is available on all nodes, why do you need one node to be the "owner" of the data?
- the nodes don't need to be for a special region. there should be the possibility of several nodes that are in the same geographical region. if opencaching.com wants "their" node to cater to geocachers around the world (like gc.com and navicache do now), they are free to do so. if geocaching.de/opencaching.de wants their frontend and features to be the best thing for german-speaking geocachers, they can do so, too. but still, all caches are available from all these sites.
- the user gets the freedom to choose what node he wants to use depending on the features its frontend offers etc., not based on what node is in his region.
if opencaching.com will run a node in the U.S. and navicache maybe (that is only a speculation!) switches to being an opencaching-node, too, that's no problem. competition is a good thing and the user is free to choose whatever node he wants to use (i think i'm repeating myself...).


the most important thing is the bold question up there, i'm a bit confused. i don't really understand why you make that regional distinction, yet you say, that all nodes should have access to all data... i don't think the scheme of "server-user-areas" isn't really neccessary, of course a node can make a frontend that is specifically for users of their region, but that doesn't have anything to do with the data itself... please explain why you think it is important for making replication easier to have an owner of a dataset. if i create a cache on one node, but update it on another, which node would be the owner then?
_________________
Quoth the raven, "Nevermore"
Back to top
View user's profile Send private message
Team BMW-Biker



Joined: 01 Oct 2003
Posts: 209

PostPosted: Sat Oct 04, 2003 4:49 pm    Post subject: Reply with quote

Hello,

thank you very much for critical feedback !

Quote:
maybe just don't understand them clearly Wink

maybe i just don't explain them clearly eneugh Wink

Quote:
full nodes vs. regional servers
your system uses "server-user-areas", where each server/node is the "owner" of the data from users from his geographical area. i imagine a system where the data is totally the same on all nodes and no node is the "owner" of some data this has several reasons

the owner has no right for this data, its just to keep replication easy (and a few other reasons).

- If one user makes changes on his content (like one of his caches) and another user makes also changes on this, but on another Core-Site, there will be a collision by replication - its not important to protect against that but work vs. use is in "harmony".

- The ressources of every server has an end. If one server has an extremely good frontend and many users store on this their logs (with pictures - which arent replicated) traffic and volumne will grow. Maybe this server cannot store this mass of informations ... with the Server-User-Areas, we will get a scalable solution. It doesnt matter how good any frontend is, the (image) data is stored on an defined point. If one server will get too much traffic, his area is divided into 2 and the other half goes to another server which has ressources free ...

- whats about offered informations, textes and such things that are breaking "any line" (laws etc) ... i think with an owner, we can implement a secure way for delete items. The owner has exclusive rights to delete/change an item (to biggest problem there is the admin of this site - he could getting a dictatory like GC Wink ) ... but if someone is begining to do that, we could fast change "the owner" of his informations and drop him out of the replication-circle (we must talk also about how to change the owner).

Quote:
- it's failsafe, if one node goes down for whatever reasons, the users can instantly switch to another node and still have all their caches, logs etc. available to them. ok, i looked a bit closer at your proposal and saw that you also want to do a full replication

- if one node goes down, the data owner can simply changed by setting another "owner-guid" ... after the next replication-circle all will work fine again (only pictures are lost) ...

- also read the security-thread - whats about handling email-addresses (not every user wants to have a "shared email") we cannot prove abuse for every time and every core-node !

Quote:
the nodes don't need to be for a special region. there should be the possibility of several nodes that are in the same geographical region. if opencaching.com wants "their" node to cater to geocachers around the world (like gc.com and navicache do now), they are free to do so. if geocaching.de/opencaching.de wants their frontend and features to be the best thing for german-speaking geocachers, they can do so, too. but still, all caches are available from all these sites


it is not neccessary that a frontend is on the server who owns the data. Syndiacted datas can used for this, we could expand the changed-notifies (descibed on Replication Protokoll) so that this informations are sended to other sites than core-sites. If this frontend wants to change the informations (caches etc.) it must only contact the owner-server to do this. Every Core-Site must give full write-access (after autentification) to its owned data.

But I think the Core-Server shouldn't be owned by "the goups" or "the countries" - they should be owned by "the Opencaching NetWork" and every group in its "geografic region" should have the ability to use this server for their sites ! So we will keep the number of core-sites low ...

Quote:
the user gets the freedom to choose what node he wants to use depending on the features its frontend offers etc., not based on what node is in his region

sure

i hope its now more clear Laughing

Please send open questions, i look to write "Version 003" next week ...

BTW: if any other solution can solve the named problems - we must talk about it !
Back to top
View user's profile Send private message Visit poster's website
Renegade Knight



Joined: 15 Sep 2003
Posts: 151

PostPosted: Sat Oct 04, 2003 11:20 pm    Post subject: Reply with quote

One thing to keep in mind is that as opencaching comes into being that several things must be balanced.

This is a partial list. More things will come along as we develop this organization.

1) Putting data into the hands of geocachers.
2) Protecting the data from people who don’t need it or who would cause other problems.
3) Landowner concerns. Part of why we are doing this is to become self regulating rather than having landowenrs ban geocaching as a nuisance or make the rules so restrictive that they might as well have banned it.
4) Finance the site. Many members make a site inexpensive for everyone who uses it. There does need to be a site and it does have to make enough money to pay for bandwidth, servers, continued development, and a myriad of other things that will come up. The site has to give the members a reason to come here, or they won’t.

The solution to one problem can prevent another problem from being solved. The site needs to address the needs of the entire community by looking at solutions until the one that does the best overall job is decided on.

If we pick out a distributed network and learn that it prevents us from accomplishing something else that is important that we didn’t think of until down the road, all that work will be scrapped and we will start over.

The site can be built using a conservative model that allows the most future flexibility. By doing that we get a site up ASAP and yet as the organization grows it can continue to solve problems as they come along. Since the organization will be owned by geocachers it will now be the community as a whole that directs the long run vision.

The question is what is a conservative model that allows the most flexablity to solve problems as they come along. The goal is to not have to scrap the work we do and start over should a problem come along that needed a different site model to solve.
Back to top
View user's profile Send private message Send e-mail
SpinWebby



Joined: 12 Oct 2003
Posts: 1
Location: Des Moines, Iowa

PostPosted: Sun Oct 12, 2003 9:39 am    Post subject: Have you considered?... Reply with quote

First, I must admit, I haven't done alot of reading here as yet, but RSS may be an option. Its a combination of news reader and email using XML. I use FeedDemon to read my messages. I'll go explore Navicache for now, but thought I'd mention it in case no one has yet.
_________________
=======================
SpinWebby
Great Plains Geocaching
www.gpgeocaching.com
=======================
Back to top
View user's profile Send private message Send e-mail Visit poster's website
Display posts from previous:   
Post new topic   Reply to topic    opencaching.com Forum Index -> Issues, decisions, answers All times are GMT - 5 Hours
Page 1 of 1

 
Jump to:  



Powered by phpBB 2.0.6 © 2001, 2002 phpBB Group