#ubuntuone 2009-12-01 <thomas_> morning people <aquarius> hey thomas <thomasvs> aquarius: so my last standing 'bug' is 100% CPU on the applet, just filed that with an strace log <aquarius> thomas_, is it your quest to use every possible irc nick? ;-) <thomasvs> aquarius: sadly the applet doesn't seem to have a way to give me debug info to figure out what it's doing exactly <thomasvs> aquarius: heh :) <thomasvs> aquarius: I have three machines I regularly work from, my belgian desktop, my spanish desktop, and my laptop <thomasvs> aquarius: hence my interest in desktopcouch I guess :) <aquarius> ah, hence many names, got it :) * aquarius laughs! <aquarius> yes indeed <aquarius> 100% CPU, odd. Ah, just got the bug <thomasvs> ok, I'm going to wait for dobey to wake up for that applet bug before I dig into it myself <thomasvs> which means I"ll wait a bit more on doing the final test on this work desktop, but I just installed all packages and the applet popped up without throwing any error, and directed me to the u1 site, so stuff seems good <thomasvs> after that last bug is fixed I'll make some noise about the final packages <aquarius> the applet is a dobey thing, so he will have a stronger clue than I do <aquarius> ah, you already know this :O) <aquarius> wow, so it's very close to being done. Thumpingly good work, that man :) <thomasvs> it's been a ride, but let's not claim victory just yet <thomasvs> I should find a machine to upgrade to f-12 too to check <aquarius> what sort of noise? <thomasvs> aquarius: blogging about it, then submitting stuff to fedora's repo <thomasvs> I've had quite a few pingbacks on doing this, surprisingly <thomasvs> it's almost as if people are interested <thomasvs> it feels strangely motivating <aquarius> oh, noise to alert people that you've done it, not noise at us about stuff beign wrong ;-) <aquarius> I am well pleased that people are interested; I think it's cool tech <aquarius> and already bringing it up on Fedora has shown areas where the code needs improving, which is immensely useful <aquarius> or where we accidentally did Ubuntu-specific things without knowing it, like the certificate stuff <thomasvs> yeah, the hardest part is taking it from 'works on one thing' to 'works on two things'. from that point on it gets easier. <aquarius> I'll remind you of that if ever a Windows port comes along :) <thomasvs> heh, well, that's an other thing entirely, but good to see that you at least consider it :) <aquarius> certainly if the archangel Michael arrived and said "here is a diff to make desktopcouch work on Windows too" we wouldn't refuse the patch. I'd like to see DC on Windows/Mac too, definitely, it's just not going to happen in the very near future if I'm doing it. :) <aquarius> thisfred, you up for a conversation about design documents, or do you want to eat breakfast or something first? :) <thisfred> aquarius: in a bit: foundations standup, then shower, so around 8:30 maybe? <aquarius> *nod* (about 45 minutes?) <thisfred> right <thisfred> sry, for being US-centric, it rubs off quickly ;) <thisfred> aquarius33ec:265c:71fe:e26d:2682:4ec2:aaa1:99ab ready when you are <aquarius> thisfred, this is actually something brought up by thomasvs. He's publishing CouchApps to his desktopcouch, and wants them on all his other desktopcouches <aquarius> but...you can't write views to couchdb.o.u.c because you're not an admin <aquarius> so views don't get synced <aquarius> thus, fail <thisfred> aquarius: ah, that would be a feature request in couchdb then? <thisfred> we specifically exclude only viws with the u1_ prefix <thisfred> weird though <aquarius> rly? <thisfred> users are allowed to create and delete dbs <aquarius> so I should be able to write a design document to c.o.u.c? <thisfred> so creating views should work too <thisfred> aquarius: I think so <thisfred> as long as it's in one of your dbs <thisfred> obviously <aquarius> thomasvs says that when replicating, it doesn't replicate design documents. thomasvs? <thisfred> that would be a bug, either in our validators, or in couchdb itself <thisfred> replication by default does take ddocs along right? <aquarius> ah, good. I wasn't sure whether we were explicitly stomping on design docs :) <thisfred> or do we need to flip something to allow that <aquarius> don't you have to be an admin to write a design doc? <aquarius> and users are not admins <thisfred> aquarius: I don't have it all in my head, but I think we give users (damn near) admin rights in their own namespace <thisfred> aquarius: or they wouldn't be able to create dbs either <aquarius> I'm not sure exactly why this might not be working, which is why I wanted to make this problem part of your life :-) <thisfred> aquarius: I'll have a quick look for any obvious stupidity in the validator function <thisfred> me either, but we can find out <thisfred> aquarius: we need to ask thomasvs to try direct replication over lan, to eliminate one source of the problem <thisfred> (using d-c replication) <aquarius> yes <thisfred> aquarius: but if it's not that, I think it <thisfred> s fair to drop it on my plate <aquarius> I am starting to think that we need a proper replication test suite <thisfred> function(newDoc, oldDoc, userCtx) <thisfred> {if (newDoc._id.indexOf('_design/u1_') == 0) <thisfred> {throw({forbidden : 'system design document'})}} <thisfred> aquarius: +1 on that <thisfred> the validator looks fine <aquarius> yeah, so that can't be the problem. weird. let's see what thomasvs has to say when he's free <teknico> aquarius, seen mandel? <aquarius> not today, nope <aquarius> apparently he has an actual job he has to attend to sometimes :) <teknico> he does? :-) <teknico> just did some more tortur^W reviewing of his branch :-) <dobey> Chipaca: hola. you rang? <dobey> hmm <thomasvs> aquarius, thisfred: ok, I will doublecheck that it actually doesn't work, maybe I did something wrong. It makes it harder seeing as I can't actually see what's in my u1 couchdb :) <thomasvs> aquarius, thisfred: I will try the sync on my work desktop as soon as dobey has a solution for the 100% cpu applet thing :) <thisfred> thomasvs: yeah, I understand. aquarius is there a reason why we shouldn't publish something like webm0nk3y's web_api tool for debugging purposes? <vds> it's time! <vds> Desktop+ MEETING BEGINS <vds> aquarius Chipaca__ dobey urbanape CardinalFang teknico jblount <teknico> me <vds> you know how it works <vds> me <vds> rodrigo_: <CardinalFang> me <jblount> me <rodrigo_> me <Chipaca__> ðºð² <dobey> me <aquarius> me <teknico> DONE: landed the branch updating the Funambol code to v. 8.0 (#403435), reviewed mandel's branch again <teknico> TODO: expose SMS methods in Funambol Server API (#381398), triage my 20 bugs <teknico> BLOCK: none <teknico> next: vds <vds> DONE: funally finished the two branches to port funambol v8 in sourcedeps, tried to start funambol on a random port to make funambol one of the server that starts with make start but no luck, I guess we'll start it only if we need it, triaged bugs, discussed about the status of the mobile sync, started a branch to wrap funambol sms api <vds> TODO: finish the branch <vds> BLOCKED: nope <vds> CardinalFang: please <CardinalFang> DONE: reviewed mandel's branch. Made draft desktopcouch API for attachments. <CardinalFang> TODO: throw it away and start over. <CardinalFang> BLOCKED: None <CardinalFang> jblount, what's for lunch, and your goals? <jblount> DONE: Bugs sorted, meetings, post-holiday fuzz worked through <jblount> TODO: I have some bugs to deal with on the /files/ ui, ping johnlea about some contacts stuff <jblount> BLOCKED: Nope <jblount> rodrigo_: ! <rodrigo_> â¢ DONE: Added couchdb-glib documentation to xdg page. Looked at music store API. Fixed a bug in Evolution contact preview widget. Music store architecture discussions and planning. Contacts picker <rodrigo_> â¢ TODO: Conflict resolver tool in pair tool. Look at becoming a MOTU (https://wiki.ubuntu.com/UbuntuDevelopers). Make sandy's snowy test suite work with our server (http://git.gnome.org/cgit/snowy/tree/api/tests.py). Discuss with jdo and aquarius about oauth token per app, not per machine? Talk to John Lea about contacts widget mockup <rodrigo_> â¢ BLOCKED: no <rodrigo_> Chipaca: go! <Chipaca> DONE: lots of emails and meetings. TODO: continue talking about music store, and nail down somebody or somebodies to fix NoAccessToken bugs. BLOCKED: nevah! NEXT: dobey <dobey> âº DONE: Triage, Backporting, Arguing (it builds character, and teams) <dobey> â¹ TODO: More backporting, Triage, Prepare releases/SRUs <dobey> â¹ BLCK: None. <dobey> aquarius: hit it <aquarius> â DONE: music store planning <aquarius> â TODO: look at oauth-enabling twisted; make tomboy first-sync experience nicer; continue work on desktopcouch developer docs; write up things learned at UDS/sprint; work with rodrigo on Music Store, much more music store architecture planning <aquarius> â BLOCKED: <aquarius> chipaca, go <aquarius> er, oops <aquarius> not Chipaca :) <aquarius> urbanape, ? <Chipaca> aquarius: you were the last 'me' <aquarius> I was indeed <vds> so EOM I guess, thanks! <thomastp> dobey: let me know if you have time to look at that applet bug <dobey> thomastp: it's one of the hundreds of bugs i have to look at i guess, yes :) <thomastp> dobey: uh oh :) <thomastp> dobey: well, maybe a first feedback would help <thomastp> for example, should the applet have logging ? <dobey> it does, but i don't think it would help here <CardinalFang> aquarius, Attachments! <aquarius> CardinalFang, I can't send email, smtp.canonical.com keeps timing out :( <dobey> thomastp: the stable release only logs INFO and ERROR, and the only way to change it is edit the code to log DEBUG and worse <CardinalFang> aquarius, scenarios: You are making a new record. <dobey> thomastp: if you change ubuntuone/oauthdesktop/logger.py to have logging.DEBUG for LOG_LEVEL instead of logging.INFO, you'll get more log messages, but probably nothing particularly relevant to your bug <thomastp> dobey: so, you'd accept a patch for example to add an option for that ? <CardinalFang> aquarius, r = Record(...); r.attach(f, "name"); db_obj.put_record(r) ? <aquarius> CardinalFang, ya <dobey> thomastp: the applet will be going away soon. <CardinalFang> aquarius, Next scenario: you already have a record. <thomastp> dobey: oh ? <dobey> thomastp: yes, we're going to be fixing the experience to not involve opening a browser, and to be more well integrated into the file manager/etc... and the applet won't exist. <thomastp> dobey: ok, so not much point focusing on improving it, and also unlikely you'll look at my bug :) <CardinalFang> aquarius, r = dbobj.get_record(record_id); r.attach(f, "name"); ... # then what? dbobj.update_fields(record_id, d) does not work. <dobey> thomastp: i have a feeling that the 100% cpu thing may very well be something with twisted <CardinalFang> "does not work" == "is ugly". <aquarius> CardinalFang, er, dbobj.put_record(r), no? <thomastp> dobey: me too <aquarius> CardinalFang, same as if I change a value <dobey> thomastp: well i haven't seen any complaints to that effect about the applet on ubuntu. but i will definitely put a fix for it in stable-1-0 <CardinalFang> aquarius, ah, I guess so. Hrm. <dobey> thomastp: there are some other complaints too, that pulling twisted out of the applet would fix <CardinalFang> dobey, quit yer hatin' on Twisted. <aquarius> CardinalFang, so, fetch-record, add-attachment-to-record, put-record. <dobey> thomastp: does syncdaemon also use up 100% cpu in the same manner? <thomastp> dobey: nope <thomastp> dobey: I've had twisted+gtkreactor taking 100% cpu bugs before due to a bug in python, I thought I had a fix for that installed, but not sure <dobey> CardinalFang: if it would only stop screwing with the main loop timing... <thomastp> dobey: screwing how ? <dobey> thomastp: the glib/gtk reactor alters some timing in the glib main loop <dobey> thomastp: so it wakes up once every 10 seconds at least <dobey> even if it doesn't really need to <thomastp> every tenth of a sec you mean ? <thomastp> that's pygtk I think <dobey> maybe 10 times/second yeah <dobey> let me see <thomastp> that would be this bug: https://bugzilla.gnome.org/show_bug.cgi?id=481569 <ubottu> Gnome bug 481569 in gobject "Calling gobject.threads_init() causes a lot of wakeups" [Normal,Resolved: fixed] <dobey> bug 475447 <ubottu> Launchpad bug 475447 in ubuntuone-client "Ubuntu-One client/syncd cause 10 wake ups / second each" [Undecided,Incomplete] https://launchpad.net/bugs/475447 <urbanape> aquarius: sorry, out today watching the sick kid <aquarius> urbanape, no problem, I wasn't sure <dobey> thomastp: hrmm, interesting <dobey> thomastp: but twisted also does stuff <rtgz> What's the best way to store a date field in CouchDB? seconds-since-epoch, ISO 8601 or application-specific (bad-bad-bad). Empathy uses %Y%m%dT%H:%M:%S which is neither of the above and it looks ugly. <thomastp> dobey: what sort of stuff does twisted do that causes issues ? <thomastp> my experience with twisted has been nothing but stellar <dobey> thomastp: the gtk2/glib reactor does some stuff with iteration timing <dobey> thomastp: see the doIteration and simulate methods in Gtk2Reactor <CardinalFang> rtgz, ISO 8601. <CardinalFang> rtgz, Empathy's is 8601 except for time zone? <rtgz> CardinalFang, it is missing the dashes between y,m and d + missing timezone <rtgz> CardinalFang, message time='20091029T18:25:15' <rtgz> CardinalFang, erm, it is defined by standard as well... <CardinalFang> Ah. Dang. So close. <CardinalFang> rtgz, ah. right. """So a time might appear as either "134730" in the basic format or "13:47:30" in the extended format.""" * CardinalFang hugs Wikipedia. <rtgz> CardinalFang, The extended formats are preferred over the basic formats not only for human readability, but because some basic formats can appear to be ambiguous to those unfamiliar with the standard. * rtgz is happy <CardinalFang> rtgz, Python datetime.datetime needs a striso8601ptime function. * CardinalFang wishes he could talk to aquarius. <CardinalFang> thisfred, you alive? <thisfred> CardinalFang: yessir <CardinalFang> thisfred, great. desktopcouch and attachments. On Record, .attach(file, str), .detach(str). How should we retrieve an attached blob? <CardinalFang> I'm trying to think of what's Pythony. <rtgz> CardinalFang, isoformat() looks fine to me... and fromtimestamp()... <thisfred> from the db? record.get_attachment(attachment_id) and have that return a file like object? <CardinalFang> thisfred, record doesn't know anything about the db. It holds data. <CardinalFang> db.get_attachment(record, attachment_name) ? <thisfred> CardinalFang: it could defer to a database method get_attachment(record_id, attachment_id) <thisfred> exactly :) <thisfred> or does it not hold a reference to the db at all? <CardinalFang> scottashley@example.org. <thisfred> If so, it probably should. I'd like to be able to record.store(id=None) and record.load(id) <thisfred> or something <thisfred> unless there's a good reason not to have the reference <thisfred> I forget <thisfred> but I don't think so <CardinalFang> As it is, thisfred, one could get a record from one place and put it in another place. We'd lose that. <thisfred> Ideally, a developer would not have to instantiate a database object in most cases * CardinalFang thinks. <thisfred> CardinalFang: we could make a copy of the object and change the underlying db <thisfred> perhaps <thisfred> oh noes, who broke the aquarius? <thisfred> CardinalFang: record as is is independent of couchdb, which is kinda nice <thisfred> but probably not all that useful <CardinalFang> thisfred, How about this: When I build a record, fabricate getter functions for those attachments, with the source DB object in the closure. <thisfred> CardinalFang: that could work, but it's more complicated than storing a reference to the db, and has no obvious (to me) advantages. I'd store the reference when we get a record from the db, and make the get_attachment method fail if self._db is None or some such <__lucio__> aquarius_broken, ping <thisfred> then we could also have self.save(id=None) <thisfred> that would call to the db.store_record() or whatever it's called <CardinalFang> "put_record" <thisfred> we are creating a two way dependency between Database and Record, but I think that's ok, since they're in the same package <thisfred> CardinalFang: either way, I'd like to hear aquarius_broken <thisfred> on the subject <aquarius_broken> hey <aquarius_broken> sorry, stupid web client <aquarius_broken> what would you like my opnion on? <aquarius_broken> __lucio__: pong <CardinalFang> aquarius_broken, thisfred suggests binding Record to CouchDatabase. One can operate on Record directly and update a source database. <aquarius_broken> I don't think so. I quite like that Records are independent, and you have to explicitly db.put_record to store them <thisfred> aquarius_broken: ok, but that means you'll have to do db.get_attachment(record_id, attachment_id) as well <thisfred> not a big problem IMO, but not as pretty as record.get_attachment(attachment_id) <aquarius_broken> why? <CardinalFang> aquarius_broken, I like that they're separate too, except I'm trying to decide on the best way to get attachments. I attach() and detach() are on Record. When we get a record, we don't want to download every attached BLOB so that we do not need the DB any more. <aquarius_broken> I think that record.get_attachment should fetch the attachment when it's asked for <aquarius_broken> agreed, so there's a binding there <rtgz> there is a Russian joke about Chukchi. It states: There was a writers contest in some newspaper and one of the participants was Chukchi. When the editorial staff got to the text they could not understand anything. So they called that Chukchi and asked. "Have you even read the thing you mailed us?". And the response was "No, chukcha is writer, chuckchi is not reader". <thisfred> aquarius_broken: for that it needs a reference to the db <aquarius_broken> but basically a Record stores a reference to its attachments <aquarius_broken> and then lazily fetches them on demand <aquarius_broken> I admit that this slightly breaks the "be independent" thing * rtgz finished the prototype for Telepathy messages stored in CouchDB, Text only. Now he needs to find out how to read things back in a user-friendly fashion <__lucio__> aquarius_broken, do you have enough internet so we can discuss file sharing as a content delivery platform? <CardinalFang> aquarius_broken, thisfred, give me a while and I'll show you an idea implementation. <aquarius_broken> but we're only stepping away from that for performance reasons; think of this as a performance optimisation <aquarius_broken> __lucio__: I do, I think, as long as it's here <aquarius_broken> __lucio__: I can only get web access, and freenode has the web client <thisfred> CardinalFang: ok <aquarius_broken> I hate my life, incidentally, in case it wasn't clear <CardinalFang> aquarius_broken, who's your Intertubes provider? <CardinalFang> ...normally? <__lucio__> aquarius_broken, ok. so, i think that doing that with file sharing is interesting. but id like to have a bigger idea before we so one implementation. statik gave me a list of possible uses of content distribution <aquarius_broken> CardinalFang: Virgin Media <aquarius_broken> __lucio__: yep <__lucio__> aquarius_broken, would we make all of this work around UDFs? whats the best user experience we can think of? <statik> best user experience I can think of is music into ~Ubuntu One/Purchased Music or ~/Music/Purchased, and make rythymbox automatically notice music there <aquarius_broken> __lucio__: the best user experience *I* can think of is that clicking a song downloads it in the background; when it's downloaded it appears in your music library in yoru music player; songs are actually stored in a folder inside your current music library folder called "Ubuntu One Purchased Music", and that folder is a UDF <statik> ~/Ubuntu One/Purchase Music is perhaps better because it makes it clear that the music is consuming storage quota, and that the user can copy music out <statik> to stop it being synced <__lucio__> aquarius_broken, what kind of notifications would the user get? general "file download" notification? or something better? like "you have finished downloading the album XYZ"? <aquarius_broken> statik: that's what emblems are for, though. If we think that people will be confused or not understand which folders are synced, then we need to solve that problem <aquarius_broken> statik: in order for UDFs to be acceptable <statik> sure <__lucio__> statik, i dont like magic folders inside ~/ubuntuone <dobey> :-/ <statik> CardinalFang just started talking about bittorrent <aquarius_broken> __lucio__: the way I'm imagining it working is that when you buy a song, you'll be shown, inside the music player, which songs you've recently purchased and whether they're downloaded or not (so there'll be an "in progress downloading" page, much the same as Software Centre has an "In Progress" page, so we're consistent with them) <Chipaca> __lucio__: question: can we create a share owned and shared to the same person? <statik> also i promised popey that we would give him free music <statik> :D <__lucio__> aquarius_broken, so, how would the music store know which files are actually the ones that are being downloaded? <CardinalFang> I like re-using syncdaemon code to download music. I hate that it has anything to do with my ~/Ubuntu\ One directory. <__lucio__> aquarius_broken, do we do one UDF per song, per album, per purchase, for all the purchased music? <jblount> statik: fabsh wants music too: http://twitter.com/fabsh/status/(572)227-8934 <aquarius_broken> because it knows which ones you chose, so it can look in the folder and see if they're there yet. <__lucio__> Chipaca, you dirty thing <aquarius_broken> __lucio__: I think your Purchased Music folder is a UDF <Chipaca> your honor, he's not answering my question <__lucio__> Chipaca, yes we can. it may have some side effects we have to hunt and kill. <Chipaca> __lucio__: correct me if I'm wrong, but wouldn't that be a quick-and-dirty non-documented way of getting a UDF? <__lucio__> Chipaca, that means that it will use double the disk space <__lucio__> Chipaca, and the location would be ~/Ubuntu One/Shared With Me/My Purchased Music <Chipaca> hmmm * rodrigo_ needs to get out for a little bit, will follow the discussion from the log <dobey> yeah, must go get food and do some errands <CardinalFang> Lunch. Back to yell about music in 1h. <__lucio__> aquarius_broken, we need soemthing better. when you install apps you have units that are bigger than single files, whole apps. so if i buy a disk, i dont want to follow every single file to know if it finished downloading. <aquarius_broken> __lucio__: yeah, but songs aren't like that. <aquarius_broken> you buy a song, it's a song. <joshuahoover> CardinalFang: should bug 442120 be fix released for the desktopcouch project (i assume it should be since it's fix released on the package/karmic) <ubottu> Launchpad bug 442120 in desktopcouch "desktopcouch-service crashed with RuntimeError in find_port__linux()" [High,Fix released] https://launchpad.net/bugs/442120 <__lucio__> aquarius_broken, albums are. <aquarius_broken> so? look at, for prior art, the existing Amazon MP3 downloader; it shows you download progress per song, even if you buy an album. <aquarius_broken> If what you want is download progress for the whole album at once, that's not hard to do. <__lucio__> aquarius_broken, we could just change what we show client side. the downloads in progress already is code we have to do, right? <__lucio__> so we can have specific messages and everything appropriate for content delivery <aquarius_broken> __lucio__: yeah, but it's almost entirely trivial code. (for file in things_downloading: if os.path.exists(file): print "done"; else: print "waiting") <aquarius_broken> and it can certainly be done with more detail than that if you want <aquarius_broken> I'm just thinking about the minimum requirements here * rtgz posted http://blog.rtg.in.ua/2009/12/telepathy-logging-to-couchdb.html <__lucio__> aquarius_broken, you can use dbus and give better information <__lucio__> aquarius_broken, but yes, we can give whatever user experience we want as long as the music store app knows what files make each item/purchase <aquarius_broken> __lucio__: absolutely, and that'd be really good :) <aquarius_broken> __lucio__: and it will know <__lucio__> aquarius_broken, so, if we put stuff in ~/Ubuntu One/The music i paid for/ , what happens when we have UDFs? How do we get that into rhythmbox? <__lucio__> aquarius_broken, what if a user with a netbook wants to buy gigabytes of music? <aquarius_broken> __lucio__: ah, that's still to be decided. What *I* think is that we create a "Purchased Music" folder which is a subfolder of your music library folder (~/Music by default) and we make Purchased Music a UDF. <aquarius_broken> users with a netbook: what about them? That's no different to the case of "what if a user with a netbook wants to store 50GB of OpenOffice documents in U1", is it? <__lucio__> aquarius_broken, theres is real risk that we cant do UDFs for lucid. <aquarius_broken> __lucio__: yep, so if UDFs don't arrive then the folder is ~/Ubuntu One/My Purchased Music, and we add a symlink to that folder to the music library. A better solution would be to teach media players about multiple library folders, but I think that will be hard. <__lucio__> aquarius_broken, how about migration then? <aquarius_broken> migration? <aquarius_broken> rtgz: sweet empathy work! I have a couple of questions about it once we've finished this discussion, if you have time later? <aquarius_broken> __lucio__: do you mean: if we set up that symlink for Lucid users, and then we get UDFs in lucid+1, should we make the folder a UDF automatically? <aquarius_broken> __lucio__: if so, I think no. Since at the moment we don't detect if someone's changed ~/Documents to be a symlink to ~/Ubuntu One/documents so they get their docs synced, we shouldn't try and be cleverer than that for music. <__lucio__> aquarius_broken, ok. what about the "content delivery api", is that a public api? internal api? is the serive just "give X to Y"? do we do it just because we dont want to touch the music store pprivate api? what exactly the benefit it gives to each party? <aquarius_broken> there isn't a "content delivery API". We have the ability, on the one.ubuntu.com server, to add new files to a user's Ubuntu One folder if they ask for them somehow (by purchasing some music from our music store, for example) <aquarius_broken> the benefits it gives for users are: they already understand Ubuntu One and how its files work; this is an extension of that. It means that things that they get from Ubuntu One are automatically Ubuntu One data, which means they'll act like other data they've put in Ubuntu One. It provides a consistent home and experience for all dealings with Ubuntu One services. <aquarius_broken> Benefits it provides for us, the U1 team: we've already spent ages building a way of getting files from o.u.c to desktops, which is robust and clever and can cope with your net connection being flaky or limited bandwidth, so we're using it again rather than building a new thing which will *also* have to cope with those things <rtgz> aquarius_broken, sure <__lucio__> aquarius_broken, there is an api, i wont let you get your hands on the model code and just touch the db :) <aquarius_broken> __lucio__: ah, right, yeah, but that API will be called by code in the server from the web, it's not exposed as an actual API to the outside world. :) <aquarius_broken> __lucio__: I wasn;t planning on just writing sql, promise ;) <__lucio__> aquarius_broken, maybe its just the controller, and you have to take care yourself about getting stuff into s3 <aquarius_broken> __lucio__: yeah. I haven't thought massively about the exact detail of how that'll work yet <__lucio__> aquarius_broken, re: we still have to build something to get files from the store provider. so whoever does that can put them on s3 i imagine. <aquarius_broken> __lucio__: yeah, that, to be honest, sounds reasonable, although reusing the existing put-files-on-s3 code as much as possible would be good <__lucio__> aquarius_broken, it can be as easy as some_s3_lib.put(storage_key, content) m but it gets a bit more complex when you want streaming, resumes, etc <aquarius_broken> __lucio__: yeah. I don't know anything about the existing code that does this stuff, but obviously I am going to need to :-) <__lucio__> aquarius_broken, welcome to twisted <aquarius_broken> yay <aquarius_broken> but my love for twisted aside, does the plan make a bit more sense now? SOrry if I didn't explain this in enough detail before :) <aquarius_broken> __lucio__: and does that cover your worry that syncdaemon wasn't right for the job? <__lucio__> aquarius_broken, yes, i like it now. i worry that the user experience may get a bit complex or we fail to provide good information to the user. but thats back to your field <aquarius_broken_> __lucio__: I spend all day and night thinking about that, don't worry :) <aquarius_broken_> __lucio__: so if it turns out rubbish after all, you can blame me, and then you can shoot me. <__lucio__> aquarius_broken, i only care about the shooring <__lucio__> shooting <aquarius_broken_> __lucio__: haha! bring it on. I saw you with the handgun at UDS :) <__lucio__> :) <aquarius_broken_> right, good, I'm glad your worries have been alleviated :) <__lucio__> aquarius_broken_, but seriously, please think hard on how you are going to make sure we can provide enough information and still give a good ux. for example: having syncdaemon say "finished syncing" and the music store say "songs downloaded" at the same time may not be the best thing <aquarius_broken_> absolutely agreed <aquarius_broken_> I'm still mulling over how to indicate song download completion <Chipaca> __lucio__: you mean via notifications? <aquarius_broken_> need to prototype a couple of things, perhaps :) <Chipaca> because syncdaemon notifications for success are going away <aquarius_broken_> indeed they are <aquarius_broken_> and I'm not sure I want to replace them with music-store notifications for success :) <__lucio__> Chipaca, whatever we show the user <aquarius_broken_> instead, I think the download progress page should do it <aquarius_broken_> but I need to prototype that just so people know what I'm talking about :) <__lucio__> Chipaca, no more: "you have X new files"? <Chipaca> __lucio__: yes, no more "downloaded 2156 of 1346563456678865" <__lucio__> Chipaca, what about "you have X new files"? its not the same <Chipaca> __lucio__: nope, sorry <__lucio__> Chipaca, why? <Chipaca> __lucio__: design says they suck (and I tend to agree) <__lucio__> Chipaca, design said we had to have them <Chipaca> hmmm * aquarius_broken_ shows his trying-to-look-surprised face :) <Chipaca> __lucio__: when was that? <__lucio__> Chipaca, before karmic <Chipaca> __lucio__: give me a second <Chipaca> __lucio__: do you really want to read the spec? <__lucio__> Chipaca, will it give me more info apart from "notifications are sooooo last year"? * Chipaca reads <Chipaca> __lucio__: no <__lucio__> Chipaca, oh, well. your problem :) <Chipaca> __lucio__: yes <Chipaca> john__: ping <john__> Chipaca, Hi <Chipaca> john__: are _all_ u1 notifications going out? <Chipaca> john__: I mean, in the spec as "we won't do this anymore" <Chipaca> john__: if so, we'd like to know why; last year we had to put them in, so it would good if we could know the rationale <john__> I would also like to know the rationale as to why they were added last year ;-) <Chipaca> john__: otherwise it would just sit there doing nothing <Chipaca> the notifications were actually welcomed, in general, even if they aren't 100% accurate some of the time <john__> one sec... <john__> Ubuntu One should not issue notifications in direct response the user's own actions. If a user has just saved a file, they don't need to be told that the file is synced. If the file fails to sync the user should be alerted to the error however this is a separate discussion. <john__> Ideally notifications should be issued when another user updates a file that the current user has access to (both when they have shared the file and when the file is shared with them). This is a means by which the user can receive situational awareness of other users interactions with data that falls within his or her scope. This is functionality is one element of a possible events framework that is not currently in scope <john__> basically we should not issue notification in direct response to a users own actions <Chipaca> john__: and if a user needs to know if a file is sync'ed before, say, unplugging and going home? <Chipaca> john__: we do notify them when they turned the music up, how is this different? <john__> The user should be able to check that the sync is complete if they need to, but we shouldn't push notifications continuously in response to user actions. Knowing if the computer is currently: In sync, syncing or disconnected can be perhaps handled differently. <aquarius_broken_> Chipaca: isn't this what the emblems are for? <aquarius_broken_> Chipaca: files/folders that are partially synced have the partial emblem <rtgz> aquarius_broken_, Chipaca the users are not going to dive into their directories to find out whether a particular file is synced or not <aquarius_broken_> rtgz: but the notifications don't help with that either <rtgz> aquarius_broken_, if the bubble said "the files are synced" then I believe it. If I put a file into the directory and nothing tells me it is synced then it is not synced probably. And if I put the whole directory structure then I don't see infdividual emblems. It's not like remote nfs/sftp/smb connection when files are 'there' when they appear 'there'... <thisfred> bbiab, dogwalk <john__> Chipaca, good question. I think the answer is historical and that it is the expected behaviour from TVs etc.. There is also the difference between a single purpose wigit where the user is adjusting a single parameter and reporting more complex interactions which do not solely involve the changing of a parameter. I think this needs to be articulated more clearly. <aquarius_broken_> rtgz: yeah, but a folder which is partially synced should have the partial emblem on <rtgz> something like 'current tasks' like in the Software Store... <rtgz> * Ubuntu Software Center <john__> aquarius_broken_: agree <aquarius_broken_> rtgz: wanna talk about the empathy thing? (great work on that, btw!) <rtgz> aquarius_broken_, erm, am I too boring regarding the notifications? :) <aquarius_broken_> rtgz: not at all, if you're staying involved in that discussion then I can wait :) <dobey> hrmm <rtgz> aquarius_broken_, okay, so, re: empathy, telepathy and im logging. Currently only single user chats are implemented, it requires PPA version of mission-control. <aquarius_broken_> rtgz: you're storing details of chats, yes? <dobey> arguing about notifications? <aquarius_broken_> rtgz: so it's not actually specific to empathy? pidgin could use it too, for example? <rtgz> aquarius_broken_, the main questions as I see it at the moment is how to DISABLE logging for particular conversation since Telepathy does not provide anything of such kind. Empathy guys added a gconf entry globally enabling/disabling the logging but it is weird for an external logger to peek into gconf for Empathy to find out the setting <rtgz> aquarius_broken_, it is Telepathy-specific client listening to DBus messages and reacting when telepathy sends notifications about new channels (new chats) <aquarius_broken_> rtgz: ah, sorry, I wasn't clear. YOur client is Empathy-specific, certainly. But if Pidgin decided to store its logs in desktopcouch, it could use the same record format, yes? <dobey> john__: if you want to know why they were added, ask beuno/djsiegel <artir> hey, do you know if it's possible to have a U1 app you can feed with a string i.e. "chromium-browse,xmoto" and get that installed across all your computers? <rtgz> aquarius_broken_, the actual format for this record type is simply { "_id": "e9db6404d7970a7869c00381f3c845b3", "_rev": "1-631d84ba5af857958138fef0666d66da", "from": "scottashley@example.org", "to": "scottashley@example.org", "record_type": "http://www.rtg.in.ua/empathy-im-couchdb", "time": "2009-12-01T20:15:46", "protocol": "jabber", "message": "Bot Szanowni PaÅstwo, let's chat!"} <dobey> artir: no. but you could write a simple shell script to do it with ssh and apt-get <artir> dobey: and if my computer is out of my local network? <artir> and i don't want to have it on :) <artir> i waws thinking of storing the string in a desktopcouch, which gets replicated and then parse the string with python and install that (the program would need to run as root) <rtgz> aquarius_broken_, script snapshot: http://paste.ubuntu.com/332530/ <aquarius_broken_> rtgz: yep, that's what I thought, so that'd work fine if pidgin wanted to store their logs too. So...could I suggest that you change the record type to be something more neutral? One of the things I want to do is to encourage different apps to collaborate by using the same record type for things <aquarius_broken_> rtgz: it'd be great if pidgin stored logs and then when I switched to empathy all the logs were still readable by empathy <rtgz> aquarius_broken_, sure, the main part was to find out how to get the data from telepathy, not how to put it into the CouchDB :) <aquarius_broken_> rtgz: yes indeed -- the bit I'm most impressed with is that you got the data from telepathy, but the bit I'm most concerned about being right is how it goes into desktopcouch ;-0 <dobey> john__: https://wiki.ubuntu.com/UbuntuOne/KarmicClient <aquarius_broken_> rtgz: also, it's a really good idea if the record_type URL actually points to a page which describes the record_type (some notes ni human-readable format are fine; it doesn't have to be a schema or anything) <aquarius_broken_> rtgz: although I note that you have a page there which says "see the blog", which is good :) <aquarius_broken_> rtgz: record types don't have to be defined at freedesktop -- they can be any URL <aquarius_broken_> rtgz: there's no "official register" or anything :) <rtgz> aquarius_broken_, Basically we need from, to, date and them message itself. However this list has to be extended for protocol, or account, etc. since there may be 31313 icq display name and... no idea who else wants to have such id in another network, but they are able. <aquarius_broken_> rtgz: yeah; you'll almost certainly want some indication of which protocol it was, I think? <rtgz> aquarius_broken_, They should be at freedesktop, cause telepathy is part of freedesktop, desktopcouch is part of freedesktop and I don't like that google site :) * aquarius_broken_ laughs <rtgz> aquarius_broken_, I suspect that the logs are of no use if nothing can read them so it is necessary to create a log reader that reads directly from couchdb and see what bits are missing <aquarius_broken_> rtgz: it would be good to bring up the format on the desktopcouch mailing list for discussion, perhaps, and mention it to a pidgin developer or amsn developer to get their thoughts into the discussion? <rtgz> aquarius_broken_, the guys at #telepathy had an idea to finally create external logger/framework some week or two ago (the only existing external logger so far is in Nokia's Maemo) <aquarius_broken_> cool! <aquarius_broken_> your work would be an excellent demonstration of that :) <rtgz> aquarius_broken_, ... and the fact that it will not work in karmic default install <aquarius_broken_> ? <aquarius_broken_> won't it? <aquarius_broken_> oh, you mean because the telepathy logger stuff won't be there, right <aquarius_broken_> I thought you meant that desktopcouch was broken :) <rtgz> aquarius_broken_, the mission-control shipped with carmic has a bug preventing new channel notification if you were the one who originated the chat :( <aquarius_broken_> :( * rtgz either writes karmic or karmik, not carmic o_O... <rtgz> aquarius_broken_, so there is a PPA containing the updated mission-control <rtgz> aquarius_broken_, *whispering* actually it is possible to obtain all info w/o updates simply by sitting and listening to DBus traffic but they discouraged me from doing that :) * aquarius_broken_ laughs! yeah, probably best to do it the proper way :) <rtgz> okay, went searching for desktopcouch mailing list, pidgin and amsn... <rtgz> hey, we have gajim as well! <aquarius_broken_> :) <rtgz> aquarius_broken_, and they have really started doing things - #telepathy - http://telepathy.freedesktop.org/wiki/Logger <thisfred> back <Bookman> I am having issues on every machine I have with Ubuntu One. It does not seems to scottashley@example.org. And on one machine, it has never synced scottashley@example.org. On another one, it used to sync up until around 10 November. On another one, it used to sync up until a couple of days ago. <Bookman> Is this project dead? <nessita> Bookman: hi there <nessita> Bookman: not at all, we're working a lot on it. <nessita> Bookman: could you please paste in pastebin.com the config files you have? you ca find those at <Bookman> From all 5 machines? <nessita> ~/.config/ubuntuone/syncdaemon.conf <nessita> Bookman: let's start with one :-) <rtgz> Bookman, can you run the diagnostic script? just to make sure we are not searching for the needle that can be found by the script itself? <rtgz> Bookman, wget http://ubuntuone-client-diagnose.googlecode.com/svn/trunk/ubuntuone-client-diagnose.py <rtgz> Bookman, python ubuntuone-client-diagnose.py <Bookman> Ok, I can only answer one thing at a time here. <Bookman> nessita, There is no file there with the name syncdaemon.conf <nessita> Bookman: ok, then run the script rtgz mentioned :-) <Bookman> Ok, problem solved. It does not work with anything other than NetworkManager. <Bookman> I cannot run that because it does not work with DSL modems anymore. Since 9.10 <rtgz> Bookman, the PPA version contains the fix that ignores NetworkManager if it is not present <rtgz> Bookman, however, the DSL problem is a bit weird, the NM contains the DSL tab, at least :/ <Bookman> Yes it sure does, but it does not connect to it <Bookman> Really broken <Bookman> It caused me so many headaches...and still is aparently. <Bookman> There is some work around but I'm not interested in work arounds. They are a whole lot more work <Bookman> Ok, a whole lot of stuff to read on that bug link but I'm still not sure what to do witht he PPA <Bookman> Ok, never mind. I'm going to switch back to Dropbox company wide. Just easier and it works. Maybe 10.04 will be better integrated. <Bookman> Thanks for trying though! I appreciate the timely response. <rtgz> Bookman, Visit this link https://launchpad.net/~ubuntuone/+archive/beta and add it to your software sources <rtgz> Bookman, then do the regular system update. <CardinalFang> Bookman, yes, Ubuntu One still depends on Network Manager. Your real bug is with Network Manager not supporting DSL properly. It should. That is its job. We have a soft plan to make the synch service work without availability notifications from the manager of the network, but it is not (afaik) implemented yet. <Bookman> CardinalFang, Understood and not a problem. Dropbox will work for now. <dobey> CardinalFang: yes it is <dobey> (implemented) <CardinalFang> rawk. <dobey> it's implemented in the code in karmic, but there was a bug <dobey> and getting SRUs done isn't trivial, but the fix is in trunk and the beta PPA already <CardinalFang> dobey, good to know. Okay, Bookman, try again in two weeks, or try our PPA. (In terminal "sudo add-apt-repository ppa:ubuntuone/beta; apt-get update") <Bookman> CardinalFang, I will wait for 10.04. <CardinalFang> Bookman, Okay. Bye. * rtgz wishes he had a DSL connection for all sorts of NM testing after he was bitten by dial-up-not-supported in 8.10... <rtgz> okay, desktopcouch mailing list notified, pidgin is on hold until the managers approve my posting :( <Bookman> Ok, from a users prospective, I just re-installed Dropbox and no scottashley@example.org. You need to really copy this model. Actually it works so well I'm not sure I understand why you are. <Bookman> Spend your time developing something else. Something not done yet. <Bookman> I've seen my dropbox solution to ubuntu one over and over and over again on the web. <rtgz> sad <rtgz> I guess I'll need to add the real fix() in u1-diagnose for NM problem advising immediate u1 ppa register and update. Otherwise... I have to the bugreport queue and pretty much of the bugs reported are duplicates of known problems with fixes around the corner... <rtgz> And, btw, the bug #387308 is strange. Is storageprotocol/proxy_tunnel.py that far from completion? <rtgz> On behalf of ubottu: https://bugs.launchpad.net/ubuntuone-client/+bug/387308 [Wishlist] Proxy Support * rtgz stops being sad and goes to bed. Bye! #ubuntuone 2009-12-02 <hackel> I copied 750 files of about 11M total into my Ubuntu One directory, and syncd appears to be caught in some kind of loop, using 100% cpu and calling calculate_hash over the same two directories over and over again. Any ideas? <__lucio__> hackel, put ubuntuone in debug, restart and contact facundobatista (tomorrow) <facundobatista> hackel, don't, we already have a bug about that <facundobatista> hackel, it's a known issue... stop the client and restart it <facundobatista> hackel, and avoid renaming a directory from .u1conflict to a non-conflict name <facundobatista> hackel, if you're interested, I can point you to the relevant bugs, for you to mark them as "it happens to me too" <facundobatista> __lucio__, ^ <rtgz> https://wiki.ubuntu.com/UbuntuOne: This protocol is built on top of Google Protocol Buffers (a sort of fast binary XMLish schema language). This abstraction is to allow extension of the u1storage protocol with breaking compatibility. <rtgz> wow <JGJones> Hello <JGJones> I'm having a bit of an issue logging into Ubuntu One via the website on Windows <JGJones> Headed to http://one.ubuntu.com and then clicked on Sign in. <JGJones> I log in successfully and I am taken back to the Ubuntu One homepage and it is still showing the same original page (Sign in) - how do I access my files? <verterok> JGJones: hi, what browser are you using? <rtgz> JGJones, could you please provide the version of you rbrowser? <rtgz> verterok, ops, me is too slow today :) <JGJones> sorry forgot to add that - latest version of Firefox <verterok> rtgz: :) <JGJones> And I'm on Windows Vista <JGJones> I'm primarily after my Tomboy notes here. <rtgz> JGJones, are you able to browse https://one.ubuntu.com/notes/ directly? <JGJones> Ah yes I am thanks <JGJones> that solve my problem - although the log in process is a tad broken? <verterok> JGJones: I just login and it worked, FF3.5 @ Ubuntu <rtgz> probably the log in process got some redirect loop, i.e. openid login targeted the sign in page... * rtgz checks on win 7 (emulated, so don't worry :) ) <verterok> JGJones: you can try removing the cookies <JGJones> verterok, I'm on Windows Vista - however I did not have any problem on Ubuntu last time I did it. <JGJones> Will try deleting cookies later on. <rtgz> verterok, no, it is not cookies <verterok> rtgz: you can reproduce it? <rtgz> verterok, otherwise it would not be possible to access notes directly. <JGJones> rtgz, did you get the same issue in Windows 7? <rtgz> verterok, JGJones hey, i am still starting it... And it is already asking things about my virtual network and whether I like to allow firefox update to update my system... * JGJones goes to fire up Ubuntu - my notes aren't sync'ed...the one I wanted isn't there. Oh well. * rtgz is all for 'Synchronize Now!'-free notes syncing, simply to local CouchDB <dobey> JGJones: clearing cache might help too <rodrigo_> rtgz: that's coming soon, hopefully <JGJones> rtgz - windows 7 can't still be starting up? <rtgz> JGJones, nope, not reproducible and I don't think it is windows-specific, to be honest <JGJones> Hmm ok <JGJones> I'll clear out my cache and see if I can do it again <rtgz> rodrigo_, yep, it is possible to set up a service that will read the .notes and put them to couchdb and fetch the updates from couchdb into notes but the applications might not be that happy about the files being changed while they are running... <JGJones> OK panic's over folks <rodrigo_> rtgz: well, the idea is to make tomboy write to couchdb directly <rtgz> JGJones, were you redirected to the launchpad OpenID login page or the original ubuntuone page telling you to back up your life with the big SIGN IN button? <JGJones> Just cleared out cache and things was fine once more. <rtgz> rodrigo_, please please pick GNote :) <rodrigo_> rtgz: I won't, but you can if you want :D <JGJones> rtgz, When I went to Ubuntu One home page - clicked on the Big Red Sign In button - and was taken to the launchpad login page. I then logged in successfully and I was taken back to the ubuntu one home page...with the Big Red Sign In button. <JGJones> After clearing out the cache - it works as expected - logging in takes me to the files page. <rtgz> JGJones, okay... trying to reproduce... <JGJones> so flushing out cache worked - although what caused it to not work in first place before clearing cache I have no idea. <dobey> i think perhaps firefox incorrectly caches the login page, and the redirect after successful log-in causes it to load the wrong page from cache <rtgz> dobey, the return_to should go to https://one.ubuntu.com/auth/complete/?janrain_nonce and afterwards the redirect is to https://one.ubuntu.com and yes, it is possible that the subsequent /files redirect failed. Just got it in lynx <rtgz> dobey, no idea whether lynx is supported or not :) <dobey> rtgz: i know what it *should* do <rtgz> dobey, I believe you are in Foundations+, right ? <dobey> no <JGJones> well hope mine's just one of those random rare case * rtgz knows three new words, Desktop+, Foundations+ and Ops+ and tries to apply them whenever possible... <jblount> Desktop+ MEETING BEGINS <jblount> Hello: dopey CardinalFang Chipaca jblount rodrigo_ teknico thisfred, time for a meeting! Please respond with "me". We'll go in that order repeating statuses in the format: DONE / TODO / BLOCKED <thisfred> dopey? :) <jblount> Heh <aquarius> thisfred does not belong to us ;) <rodrigo_> :) <jblount> Or his smarter and more aware cousin dobey <rodrigo_> me <teknico> me * jblount is going to cut his fingers off later and try out some speech to txt software <jblount> me <aquarius> me <vds1> me <teknico> jblount, maybe only the second part, pretty please? <dobey> me <jblount> teknico: :) <jblount> rodrigo_: At your leisure! <rodrigo_> â¢ DONE: Contacts picker. More music store discussions <rodrigo_> â¢ TODO: Conflict resolver tool in pair tool. Look at becoming a MOTU (https://wiki.ubuntu.com/UbuntuDevelopers). Make sandy's snowy test suite work with our server (http://git.gnome.org/cgit/snowy/tree/api/tests.py). Discuss with jdo and aquarius about oauth token per app, not per machine? <rodrigo_> â¢ BLOCKED: no <rodrigo_> teknico: go! <teknico> DONE: started exposing SMS methods in Funambol Server API (#381398), discussed various Funambol issues with Funambol people, done some reviews <teknico> TODO: do more reviews, finish exposing SMS methods in Funambol Server API (#381398), triage my 20 bugs <teknico> BLOCK: none <teknico> next: jblount <jblount> DONE: Got a branch sorted to fix a bunch of bugs
{'channel': 'ubuntuone', 'month': 12}