Open in new window / Try shogun cloud
--- Log opened Tue Oct 22 00:00:51 2013
-!- lisitsyn [~lisitsyn@80.252.20.67] has quit [Quit: Leaving.]02:32
-!- iglesiasg [~iglesias@s83-179-44-135.cust.tele2.se] has quit [Quit: Ex-Chat]02:45
shogun-buildbotbuild #586 of nightly_default is complete: Failure [failed test]  Build details are at http://buildbot.shogun-toolbox.org/builders/nightly_default/builds/58603:41
-!- HeikoS [~androirc@cpe-66-74-186-205.dc.res.rr.com] has joined #shogun05:32
-!- mode/#shogun [+o HeikoS] by ChanServ05:32
@HeikoSPing05:32
@HeikoSPong05:32
@sonney2kHeikoS, night shift!05:47
-!- HeikoS1 [~heiko@cpe-66-74-186-205.dc.res.rr.com] has joined #shogun06:14
HeikoS1okipou06:14
-!- HeikoS1 [~heiko@cpe-66-74-186-205.dc.res.rr.com] has quit [Quit: Leaving.]06:58
-!- besser82 [~besser82@77-20-93-165-dynip.superkabel.de] has joined #shogun08:40
-!- besser82 [~besser82@77-20-93-165-dynip.superkabel.de] has quit [Changing host]08:40
-!- besser82 [~besser82@fedora/besser82] has joined #shogun08:40
@wikingbesser82: yo09:17
besser82wiking: ya!09:17
@wikingbesser82: so i'm just preparing a docker file for shogun09:18
@wikingbesser82: do u know how to setup docker for fedora?09:18
besser82wiking: not yet, but I can someone who is more affine with infra....09:18
@wikingbesser82: these are the requirements: http://docs.docker.io/en/latest/installation/kernel/#kernel09:19
@wikingfor kernel09:19
@wikingbesser82: fedora infra uses openstack?09:21
@wikinghttp://lists.openstack.org/pipermail/openstack-announce/2013-October/000151.html09:21
@wikinghas native docker support09:21
-!- lisitsyn [~lisitsyn@80.252.20.67] has joined #shogun09:27
@wikinglisitsyn: yo09:30
lisitsynwiking: hey09:30
@wikinglisitsyn: do u have repo creation permissions for shogun-toolbox user on github?09:30
lisitsynwiking: lemme check09:30
@wikinglisitsyn: btw: do u know this: http://docker.io/09:30
@wikinglisitsyn: i'm just trying to put together a Dockerfile for this in order to have shogun+notebooks09:31
@wikingit's pretty great stuff09:31
@wikingunfortunately it's not tooo much native support09:31
@wikingi.e. only linux09:31
@wikingbut others can use vagrant09:31
@wikinglike i'm doing now09:31
lisitsynwiking: it doesn't look I have such permissions09:31
@wiking:(09:31
lisitsynabout docker - no idea actually09:32
@wikinglisitsyn: check this out: https://github.com/dotcloud/docker/blob/master/README.md09:32
@wikingthis is the most interesting of the whole stuff: https://github.com/dotcloud/docker/blob/master/README.md#better-than-vms09:34
lisitsynwiking: ha, another thing written in go09:35
@wikingindeed :)09:35
lisitsynwiking: sometimes I think we should use go too09:36
lisitsyn:D09:36
@wiking:D09:36
@wikingof course :P09:36
@wikingok now the question where should we store nightly packages on the website?09:37
@wikingwe shoudl totally have like09:38
@wikinghttp://www.shogun-toolbox.org/download09:38
@wikingor http://www.shogun-toolbox.org/downloads09:38
@wikingand http://www.shogun-toolbox.org/download/nightly09:38
@wikingany insights?09:39
lisitsynwiking: I am ok with any09:39
@wikingok i'll check how this can be done09:43
-!- iglesiasg [~iglesias@s83-179-44-135.cust.tele2.se] has joined #shogun10:18
-!- mode/#shogun [+o iglesiasg] by ChanServ10:18
@wikingok10:37
@wikingwhere should we store the dockerfile10:38
@wikingshould we just include it in the source repo?10:38
@wikingalthough anyway this image is going to be here: https://index.docker.io/10:38
-!- iglesiasg [~iglesias@s83-179-44-135.cust.tele2.se] has quit [Quit: Ex-Chat]14:20
-!- thoralf [~thoralf@enki.zib.de] has joined #shogun14:47
thoralfHey all.14:47
lisitsynthoralf: hey14:49
thoralfQuite empty in here.14:52
thoralfI expected a crowded channel and everyone looking forward to work on the release. ;)14:53
@sonney2kthoralf, sure thing15:45
lisitsynthoralf: ha15:46
lisitsynno money no honey15:46
@sonney2kwiking, shouldn't we put nightly releases just under ftp://shogun-toolbox.org/shogun/nightly/ ?15:48
@sonney2kwiking, or snapshots/15:49
@sonney2kwith this scheme15:49
@sonney2kshogun-3.0.0~git20131021.8dfde3715:50
@sonney2kwhich is from this logic: VER=3.0.015:50
@sonney2kGITVER=`date +%Y%m%d`.`cd shogun ; git log -1 --pretty=%h`15:50
@sonney2kDESTDIR=shogun_${VER}~git$GITVER15:50
@sonney2klisitsyn, thoralf, wiking, besser82 btw what would you want to mentor for next years gsoc?15:58
lisitsynsure why not sonney2k15:58
besser82sonney2k: Sure! I can do it :)15:58
@sonney2klisitsyn, and an idea what?15:59
lisitsynsonney2k: sorry :D15:59
lisitsynskipped 'what' part15:59
lisitsynI'd go for internals!15:59
@sonney2kbesser82, with heiko we thought you might be interested in some shogun & cloud part :)15:59
lisitsynchange guts of shogun15:59
@sonney2klisitsyn, like what?15:59
besser82sonney2k: That would be great!15:59
lisitsynsonney2k: parameters, serialization, parallel/distributed stuff16:00
besser82lisitsyn: How about getting rid of SVMlight sh*t?16:00
lisitsynoh well I have no expertise in svms to be honest16:00
@sonney2kbesser82, we thought about that too - possible but tough16:00
@sonney2kbesser82, one would have to pimp gpdt svm16:00
@sonney2kand honestly I am not sure if it is worth it16:01
besser82sonney2k: and we can fine someone with expertise in this...16:01
lisitsynsonney2k: ah yes and I still think shogun should become client/server app :D16:01
besser82sonney2k: So cloud / distributed / OpenCL computation is mine, then  ;)16:01
lisitsynthe 'training' part16:01
lisitsynI believe this is the killer16:02
besser82lisitsyn: can be done with ease when we get some distributed computation running ;)16:02
besser82lisitsyn: like in next year's gsoc  ;)16:02
@sonney2kwell think of something very concrete that can be done in <3months16:03
@sonney2kwith some easy entrance projects upfront16:03
lisitsynI would do that by myself but give me the money ;)16:03
lisitsynhaha16:03
@sonney2kwith HeikoS I had an 8 hour drive yesterday down to the south16:03
@sonney2kso we came up with a loooong list of ideas and things16:03
lisitsynsonney2k: did HeikoS push you to the funding thing?16:04
lisitsynI mean he wanted to get some money to hire someone16:04
@sonney2klisitsyn, errm it is not really that I am blocking him here16:06
lisitsynsonney2k: no I didn't say you are blocking it ;) just curious if you support that16:06
@sonney2klisitsyn, why should I block it?16:07
@sonney2kif he finds funding for any of us it would be good right?16:07
thoralfsonney2k: In general I'm interested in large scale discriminative stuff (multilabel classification, SVMs) - but haven't a clue what direction I should move.16:07
thoralfnext16:07
@sonney2kthoralf, well think about sth you would want to have in shogun / or want to see fixed16:08
@sonney2kthoralf, I mean e.g. the streaming features framework etc might need some extension/overhaul16:08
lisitsynsonney2k: sure pure good16:09
@sonney2kwe need some kind of release script16:10
@sonney2kwhere should that go?16:11
@sonney2kmain CMakefile.txt ?16:11
@sonney2kor some shell script?16:11
thoralfsonney2k: Of course, streaming and sparse computations are essential, but it's infrastructure stuff.16:11
thoralfsonney2k: I prefer working on use-cases and fix infrastructure "on the way". ;)16:12
@sonney2kthoralf, any idea for a nice use case?16:12
thoralfsonney2k: Multilabel classification.16:13
thoralf:D16:13
@sonney2kohh ordinal regression is sth I would want to have too16:13
thoralf(Or tags or whatever you might call it...)16:13
@sonney2kthoralf, yeah yeah16:13
lisitsynI'd go application-centric16:15
@sonney2kapplications is seriously the best way to show off shogun's powers16:15
@sonney2klisitsyn, if we had your traffic sign recognition thing as application that would be cool16:15
@sonney2klisitsyn, one could even make a demo out of this16:15
lisitsynsonney2k: I don't know how should it look like16:16
-!- shogun-notifier- [~irker@7nn.de] has joined #shogun16:16
shogun-notifier-shogun: Soeren Sonnenburg :develop * 6c23967 / README.md,README_developer.md: https://github.com/shogun-toolbox/shogun/commit/6c239672028335cde00a53dd0ce833f5a603cfe116:16
shogun-notifier-shogun: update readme and mention how to do a release in the developer readme16:16
shogun-notifier-shogun: and when to change the soname.16:16
@sonney2klisitsyn, some images with traffic signs can be uploaded - signs are located and classified16:17
@sonney2kbut first things first16:19
lisitsynsonney2k: big thing actually16:19
lisitsyndetection is an issue as well16:19
@sonney2klisitsyn, we really need the dimred notebook for the release16:19
lisitsynfor the release?!16:19
lisitsynsonney2k: I worked last night and night before last night :D16:19
@sonney2klisitsyn, an it is easy to do given what you did for the tapkee16:19
@sonney2klisitsyn, maybe fernando could do it?16:19
@sonney2klisitsyn, I mean it is just takeing the code from graphical examples16:20
lisitsynI am a two weeks overdue with some thing16:20
@sonney2kand the descriptions from the website16:20
lisitsynyes fernando knows about it as well16:20
@sonney2klisitsyn, ok then lets ask iglesiasg when he is online16:20
lisitsynI can draft a plan may be16:20
@sonney2klisitsyn, yeah just submit some notebook following the template and with some outline added16:21
@sonney2kthoralf, do you have any time to help?16:21
lisitsynokay I'll spend some time on that tomorrow I hope16:22
thoralfsonney2k: As always yes and no. :)16:22
@sonney2kthoralf, alright let me say what I think is the only things missing for a proper release:16:22
@sonney2kbug count etc is in OK shape16:23
@sonney2kwe only need to fix one issue and that is what Heiko needs to do here and will16:23
@sonney2kthe remaining stuff is 'just' to get the notebook cloud thing going - but that is what wiking and besser82 are doing16:24
@sonney2kand to get some nice applications  / demos16:24
@sonney2kso people love us when they see us16:24
@sonney2kthe rest is good enough(tm)16:24
@sonney2kso we need some more notebooks16:24
@sonney2kand polish the demos and integrate them into the main website16:24
@sonney2kthoralf, and for that I could use some help - I need some thumbnail images for the (already online) demos http://fatbot.shogun-toolbox.org/16:25
@sonney2kso I can place them at the bottom of our website16:25
thoralfsonney2k: notebooks are a nice challenge - anything in particular?16:25
@sonney2kthoralf, there is tons of stuff one could do wrt notebooks. we have no general intros into anything16:26
@sonney2kso descriptions for regression, classification, clustering etc16:28
thoralfsonney2k: And about the thumbnails - simply rendering the web page, taking a snapshot and shrinking it would be enough?16:28
@sonney2kthoralf, yes16:29
@sonney2kwell ne16:29
@sonney2kno16:29
@sonney2kyou unfortunately have to put some points there for regression16:29
@sonney2kto get some curve estimated16:29
@sonney2kotherwise it would just be some grid16:29
@sonney2kthoralf, but if you could do the notebooks I could ask van51 if he is up to helping out with the demos16:30
thoralfsonney2k: I'll have a look on what we have and will try to do some basic notebooks.16:32
@sonney2kthoralf, thanks16:32
thoralfsonney2k: Haven't used ipython notebooks yet, but HeikoS already did some great stuff to copy from. ;)16:33
thoralfsonney2k: One last thing: Deadline.16:33
* thoralf needs deadlines to get productive :D16:34
@sonney2kthoralf, use the template16:35
@sonney2kthoralf, iglesiasg created some template so just copy from that one16:35
@sonney2kthoralf, well do 1 notebook by end of today16:35
@sonney2ktomorrow16:36
@sonney2ksry16:36
@sonney2kwhich one?16:36
thoralfsonney2k: I'm thinking of a toy example to show sparse features & streaming & hashing.  Plotting performance for different hash sizes.16:39
@sonney2kthoralf, makes sense16:40
thoralfsonney2k: Any ideas/wishes?16:40
thoralfWhich dataset might be suitable, for example?16:40
* thoralf can generate some random data as well.16:40
@sonney2kthoralf, problem if `real' data here would be that it would be huge - some spam vs non-spam thing for that would be nice16:41
@sonney2kwell or some random stuff16:42
thoralfSomething high-dimensional, but sparse features would splitting natural language sentences into char-n-grams (n=2 or 3 would do).16:44
thoralfDo we have text data?16:44
thoralfWell, I'll do something.  No matter what.16:48
@sonney2kthoralf, well van51 has one notebook about that16:52
@sonney2kthoralf, http://shogun-toolbox.org/static/notebook/current/HashedDocDotFeatures.html16:52
shogun-buildbotbuild #1973 of deb3 - modular_interfaces is complete: Failure [failed test python modular]  Build details are at http://buildbot.shogun-toolbox.org/builders/deb3%20-%20modular_interfaces/builds/1973  blamelist: Soeren Sonnenburg <sonne@debian.org>16:53
@sonney2kthoralf, your notebook could go hand-in-hand with this one since it is only mentioning the streaming part as an extra16:53
thoralfBtw. a typo in van51s notebook "Gunar R?atsch" (reference section ;))16:54
lisitsynR?16:58
lisitsynwhat?16:58
lisitsynR?R?R?R?16:58
lisitsyn:D16:58
lisitsynhow does that sound :D16:59
@sonney2klisitsyn, very male17:06
-!- FSCV [~FSCV@23.228.64.94] has joined #shogun17:22
thoralfsonney2k: S?oren <-- Can you imagine how "S?" sounds as well? ;)17:28
thoralfSee you tomorrow.17:29
-!- thoralf [~thoralf@enki.zib.de] has quit [Quit: Konversation terminated!]17:29
@sonney2klike a rattlesnake!17:31
-!- travis-ci [~travis-ci@ec2-54-224-139-217.compute-1.amazonaws.com] has joined #shogun17:36
travis-ci[travis-ci] it's Soeren Sonnenburg's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: http://travis-ci.org/shogun-toolbox/shogun/builds/1288208617:36
-!- travis-ci [~travis-ci@ec2-54-224-139-217.compute-1.amazonaws.com] has left #shogun []17:36
@HeikoSMorning :)17:53
-!- HeikoS1 [~heiko@cpe-66-74-186-205.dc.res.rr.com] has joined #shogun17:57
-!- FSCV [~FSCV@23.228.64.94] has quit [Quit: This computer has gone to sleep]18:16
-!- HeikoS1 [~heiko@cpe-66-74-186-205.dc.res.rr.com] has left #shogun []18:20
lisitsynHeikoS: hello18:22
-!- zxtx [~zv@c-98-223-204-216.hsd1.in.comcast.net] has joined #shogun18:26
-!- zxtx [~zv@c-98-223-204-216.hsd1.in.comcast.net] has quit [Ping timeout: 240 seconds]18:35
-!- van51 [~van51@athedsl-399544.home.otenet.gr] has joined #shogun18:45
van51hello18:46
-!- besser82 [~besser82@fedora/besser82] has quit [Quit: freedom, friends, features, first ---> fedoraproject.org]18:47
@sonney2kvan51, hey!18:50
van51sonney2k: hello18:50
van51sonney2k: did you see my reply?18:51
@sonney2kvan51, we are in pretty different timezones atm18:51
@sonney2kvan51, not yet18:51
van51sonney2k: what time is it there? 10am or 12am?18:51
@sonney2k10  yeah18:52
@sonney2kvan51, just read your mail. very nice18:52
@sonney2kvan51, well thumbnails first and then trying to get demos ready18:52
van51sonney2k: ok18:52
van51sonney2k: 140x105 ?18:53
@sonney2kvan51, I mean there are still some flaws18:53
@sonney2kvan51, same size like the others we currently have18:53
@sonney2kand van51 we can work on demos as long as we want18:59
@sonney2kvan51, for now we need to get the release to be in good enough shape and then release though19:00
van51sonney2k: ok sure. Maybe I'll check some issues then afterwards19:01
@sonney2kvan51, for the screenshots you have to click some nice points together and then get some image back19:03
@sonney2kvan51, and please describe your example more19:03
@sonney2kvan51, so that it is clear that this was trained from a few wikipedia articles19:04
@sonney2kvan51, best wishes from HeikoS btw19:04
van51sonney2k: thx HeikoS, you too :)19:05
van51sonney2k: are the asp and arts examples not supposed to be working?19:05
van51sonney2k: asp works actually19:05
van51sonney2k: can you give me a brief description of those two as well so I can make some intro text?19:06
@sonney2kvan51, I will do the descr for these - the examples are not so cool display wise unfortunately19:08
-!- shogun-notifier- [~irker@7nn.de] has quit [Quit: transmission timeout]19:16
-!- HeikoS [~androirc@cpe-66-74-186-205.dc.res.rr.com] has quit [Ping timeout: 252 seconds]19:30
van51sonney2k: does the multiclass demo work for you? it's not displaying an image for me sometimes19:31
van51sonney2k: and never when I have selected the gaussian kernel19:31
van51sonney2k: https://dl.dropboxusercontent.com/u/23851310/thumbs.zip19:55
-!- FSCV [~FSCV@23.228.64.94] has joined #shogun20:15
-!- iglesiasg [~iglesias@s83-179-44-135.cust.tele2.se] has joined #shogun22:23
-!- mode/#shogun [+o iglesiasg] by ChanServ22:23
-!- van51 [~van51@athedsl-399544.home.otenet.gr] has quit [Quit: Leaving.]23:05
-!- van51 [~van51@athedsl-399544.home.otenet.gr] has joined #shogun23:11
-!- new_lido [~walid@41.218.172.136] has joined #shogun23:19
-!- iglesiasg [~iglesias@s83-179-44-135.cust.tele2.se] has quit [Quit: Ex-Chat]23:35
--- Log closed Wed Oct 23 00:00:53 2013