Open in new window / Try shogun cloud
--- Log opened Fri Nov 01 00:00:05 2013
@iglesiasgso expensive is it?00:01
@sonney2kiglesiasg, no no we get 2k$ from google as starter package00:03
@iglesiasgaah00:04
@iglesiasgvery kind these guys from Google :D00:04
-!- HeikoS [~heiko@97e0a10b.skybroadband.com] has quit [Quit: Leaving.]00:41
-!- shogun-notifier- [~irker@7nn.de] has quit [Quit: transmission timeout]01:41
-!- iglesiasg [~iglesiasg@s83-179-44-135.cust.tele2.se] has quit [Quit: Leaving]02:03
-!- zxtx [~zv@129-79-241-148.dhcp-bl.indiana.edu] has quit [Ping timeout: 272 seconds]02:28
-!- sonne|osx_ [~sonne@f053040240.adsl.alicedsl.de] has joined #shogun03:52
-!- sonne|osx [~sonne@f053042175.adsl.alicedsl.de] has quit [Ping timeout: 246 seconds]03:52
-!- sonne|osx_ is now known as sonne|osx03:52
-!- zxtx [~zv@c-98-223-198-47.hsd1.in.comcast.net] has joined #shogun04:11
-!- sonne|osx [~sonne@f053040240.adsl.alicedsl.de] has quit [Quit: sonne|osx]07:28
-!- lisitsyn [~lisitsyn@80.252.20.67] has joined #shogun07:51
-!- sonne|osx [~sonne@89.204.153.206] has joined #shogun08:08
@wikingsonne|osx: ok i'll have to work quite some time on being able to make a distributed webapp for cloud... ;P08:16
@wikingsonne|osx: as we'll need to be able to share the user instances<->container id mapping between the instances that can run docker08:17
sonne|osxwiking: well it would be cool. I guess we can get some sponsorship by our friends at google / amazon/ microsoft08:17
sonne|osxwiking: so some system that works transparently across those would be nice08:18
@wikingsonne|osx: well what we need basically is a webapp that serves the docker instances across various nodes08:18
@wikingtaking in account the load on a given nodee08:18
@wiking*node08:18
@wikingthat i guess could be a simple weighted round robin :P08:18
sonne|osxwiking: btw with HeikoS we discussed about the distributed stuff we wanted to do and it might be a GSoC project to do e.g. modelselection using azure/ec2/gcloud08:19
@wikingsonne|osx: well instances are now easy to setup08:19
sonne|osxwiking: only problem I see is how to get user data back and forth08:19
@wikingif one has docker08:19
@wikingsonne|osx: well hdfs08:19
sonne|osxwiking: so it writes to fatbot's hd?08:19
@wikingmmm wait08:21
sonne|osxwiking: errm and we should really do some backup of fatbot now08:21
@wikingsonne|osx: i thought you are speaking about distributed shogun stuff08:21
@wikingsonne|osx: because there the easiest is that u do a hdfs kind of stuff and there the nodes are r/w to hdfs08:22
sonne|osxwiking: no your cloud stuff but indeed hdfs would also fix things but no idea how this can work when your connection is rather limited (firewall?)08:22
@wikingsonne|osx: but with cloud it's not that big a deal08:23
@wikingsonne|osx: each node has it's own docker manager08:23
@wikingand the master node is just talking with these managers08:23
sonne|osxwiking: I am thinking about scenarios where you have a cluster and an entrance node08:23
sonne|osxand only the entrance node has direct network access08:23
@wikingand the master node is taking care between the userid<->docker instance id mapping08:23
sonne|osxeverything else goes via the cluster08:23
@wikingsonne|osx: this is for distributed shogun? or cloud now? :)08:24
sonne|osxwiking: but how is stuff written then?08:24
sonne|osxhaha08:24
sonne|osxthat was for distributed shogun but what I just said about your stuff08:24
@wikingsonne|osx: what do you mean how is it written?08:25
sonne|osxsry gtg08:25
sonne|osxbrb08:25
-!- sonne|osx [~sonne@89.204.153.206] has quit [Quit: sonne|osx]08:25
sonne|workwiking: I mean the data that people write when they change the notebook08:54
sonne|workwiking: how / where is this stored?08:54
-!- iglesiasg [~iglesiasg@s83-179-44-135.cust.tele2.se] has joined #shogun09:12
-!- mode/#shogun [+o iglesiasg] by ChanServ09:12
@iglesiasggood morning!09:14
-!- shogun-toolbox [~shogun@7nn.de] has quit [Ping timeout: 256 seconds]09:55
--- Log closed Fri Nov 01 09:55:14 2013
--- Log opened Fri Nov 01 09:55:23 2013
-!- shogun-t1olbox [~shogun@7nn.de] has joined #shogun09:55
-!- Irssi: #shogun: Total of 13 nicks [3 ops, 0 halfops, 0 voices, 10 normal]09:55
!sendak.freenode.net [freenode-info] channel trolls and no channel staff around to help? please check with freenode support: http://freenode.net/faq.shtml#gettinghelp09:55
-!- Irssi: Join to #shogun was synced in 8 secs09:55
-!- Netsplit *.net <-> *.split quits: shogun-toolbox09:58
-!- iglesiasg [~iglesiasg@s83-179-44-135.cust.tele2.se] has quit [Quit: Leaving]11:30
@wikingsonne|work: ah that's in aufs11:54
sonne|workwiking: aufs?11:56
@wikingsonne|work: http://en.wikipedia.org/wiki/Aufs12:09
sonne|workwiking: but how do you sync that if you would run stuff on some google cloud machine ?12:10
@wiking:)12:10
@wikingi do not have an answer for that12:11
-!- iglesiasg [~iglesiasg@s83-179-44-135.cust.tele2.se] has joined #shogun12:50
-!- mode/#shogun [+o iglesiasg] by ChanServ12:50
-!- iglesiasg [~iglesiasg@s83-179-44-135.cust.tele2.se] has quit [Quit: Leaving]13:34
sonne|workwiking: care to share?13:44
@wikingwhat?13:47
-!- iglesiasg [~iglesias@2001:6b0:1:1da0:e4f8:8e29:a992:b7df] has joined #shogun14:13
-!- mode/#shogun [+o iglesiasg] by ChanServ14:13
-!- HeikoS [~heiko@pat-191-250.internal.eduroam.ucl.ac.uk] has joined #shogun15:04
-!- mode/#shogun [+o HeikoS] by ChanServ15:04
sonne|workHeikoS: hey!15:06
sonne|workHeikoS: does it work now?15:06
@HeikoSsonne|work: hi! I have my other computer now15:07
@HeikoScould you send me the git link again?15:07
@HeikoSwill try it here then and put it into my dropbox15:07
@HeikoSotherwise I will try tomorrow from home15:08
sonne|workHeikoS: no idea :D15:08
sonne|workso try it from home15:08
-!- HeikoS [~heiko@pat-191-250.internal.eduroam.ucl.ac.uk] has quit [Client Quit]15:09
-!- HeikoS [~heiko@pat-191-250.internal.eduroam.ucl.ac.uk] has joined #shogun15:13
-!- mode/#shogun [+o HeikoS] by ChanServ15:13
@HeikoSsonney2k: finally got an encrypted folder in my dropbox for all the key stuff, you convinced me!15:14
@HeikoSsonne|work: will check the git from home then15:14
-!- zxtx [~zv@c-98-223-198-47.hsd1.in.comcast.net] has quit [Ping timeout: 259 seconds]16:18
-!- lisitsyn [~lisitsyn@80.252.20.67] has quit [Quit: Leaving.]16:37
-!- zxtx [~zv@129-79-241-148.dhcp-bl.indiana.edu] has joined #shogun17:10
-!- shogun-notifier- [~irker@7nn.de] has joined #shogun17:16
shogun-notifier-shogun-web: Fernando Iglesias :master * d000999 / static/workshop/2013/keynote.pdf: https://github.com/shogun-toolbox/shogun-web/commit/d00099954cab9cca05a2b656b9d9fccedaaffc0717:16
shogun-notifier-shogun-web: Add Gunnar's slides from workshop 201317:16
shogun-notifier-shogun-web: Fernando Iglesias :master * 55289fd / static/workshop/2013/keynote.pdf: https://github.com/shogun-toolbox/shogun-web/commit/55289fdc8a29e388c2216fb604fb21b22d6c9afa17:16
shogun-notifier-shogun-web: Merge pull request #36 from iglesias/master17:16
shogun-notifier-shogun-web:17:16
shogun-notifier-shogun-web: Add Gunnar's slides from workshop 201317:16
-!- sonne|osx [~sonne@82.113.99.211] has joined #shogun17:19
sonne|osxwiking: what do you think should I try to get some free EC2's?17:21
@wikingsonne|osx: well if gcloud is not yet ready :P17:22
@wikingbut the more the merier17:22
@wikingas they say17:22
sonne|osxwiking: azure's too?17:22
@wikingmmm whatever is possible for free :P17:22
sonne|osxwiking: you know - I know a couple of people so I might as well ask...17:22
sonne|osxkk17:23
@wikinggo ahead :)17:23
shogun-notifier-shogun: Koen van de Sande :develop * de423c2 / / (6 files): https://github.com/shogun-toolbox/shogun/commit/de423c217990f6374f5f9f98b3ce0345daa07bda17:25
shogun-notifier-shogun: Fix overflow of 32-bit signed integers when multiplying two 32-bit integers: cast to 64-bit integers first, otherwise matrices with number of elements > 2^31 (e.g. a 48,000x48,000 custom kernel matrix) will not work.17:25
shogun-notifier-shogun: Koen van de Sande :develop * 466d2ee / xiqdjx4p.sem.txt: https://github.com/shogun-toolbox/shogun/commit/466d2ee48b4a206e873d79eb6327804bf0ba66d917:25
shogun-notifier-shogun: Accidental file included17:26
shogun-notifier-shogun: Koen van de Sande :develop * a3f81b7 / src/shogun/lib/SGVector.h: https://github.com/shogun-toolbox/shogun/commit/a3f81b70eccc8a5b6921f725874365cd24e35c7517:26
shogun-notifier-shogun: Clang will not take int64_t as an index into a vector, add [] for int64_t in SGVector17:26
shogun-notifier-shogun: Koen van de Sande :develop * 6533afb / src/shogun/lib/SGVector.h: https://github.com/shogun-toolbox/shogun/commit/6533afbea3dc79d02c2f6a3459d532b9505a68b917:26
shogun-notifier-shogun: Need a third operator[]17:26
shogun-notifier-shogun:17:26
shogun-notifier-shogun: Because the uint32_t used to index vectors elsewhere now cannot choose17:26
shogun-notifier-shogun: between index_t and int64_t (before it only had the choice of17:26
shogun-notifier-shogun: index_t=int32_t)17:26
shogun-notifier-shogun: Koen van de Sande :develop * 2168003 / src/shogun/lib/SGVector.h: https://github.com/shogun-toolbox/shogun/commit/21680032da57bbd9e4ad0e80f93d2c47788885a317:26
shogun-notifier-shogun: Other try to fix ambiguities: a single operator[] with int64_t17:26
shogun-notifier-shogun: Soeren Sonnenburg :develop * 64dc831 / src/shogun/lib/ (6 files): https://github.com/shogun-toolbox/shogun/commit/64dc831f2ebaf7b0dad8d596a965f23fb319d0ad17:26
shogun-notifier-shogun: Merge pull request #1731 from koenvandesande/fix_index_t_overflows17:26
shogun-notifier-shogun:17:26
shogun-notifier-shogun: Fix overflows of index_t for large matrices17:26
@iglesiasgall right, Gunnar's slides from the workshop are in the webpage now17:26
@iglesiasgone missing :)17:26
@wikingmine i know17:27
shogun-notifier-shogun: Soeren Sonnenburg :develop * d51d89e / src/shogun/lib/SGVector.h: https://github.com/shogun-toolbox/shogun/commit/d51d89eb12763291036afb5b8ce25a3def16684617:28
shogun-notifier-shogun: add int32_t / uint32_t SGVector access functions17:28
sonne|osxiglesiasg: increadible17:28
sonne|osxiglesiasg: could you please make the video page the default for the workshop?17:29
sonne|osxiglesiasg: if I click here http://shogun-toolbox.org/page/Events/workshop201317:29
@iglesiasgsonne|osx, mm I think we talked already about that. You mean to click on Workshop 2013 and that videos appear directly17:29
sonne|osxit doesn't select videos17:29
sonne|osxiglesiasg: yes17:29
sonne|osxiglesiasg: you did it in a way that when you click on events that the workshop & videos are activated17:30
@iglesiasgsonne|osx, ok but then, when is the stuff that is currently shown in in that page shown?17:30
sonne|osxbut not the rest17:30
sonne|osxiglesiasg: ahh true17:30
@iglesiasgsonne|osx, one possibility is to show one video in the current small article called video recordings17:31
@iglesiasgjust so that the thumbnail is directly seen when clicking on Workshop 201317:31
sonne|osxiglesiasg: yeah these certainly need *PICTURES*17:31
sonne|osxboring to watch17:31
sonne|osxwiking: about the cloud thing - is all of that in the shogun-cloud repo?17:31
sonne|osxwiking: I mean templates too?17:32
sonne|osxwiking: I  would want to create some image matrix with all the notebooks we have17:32
sonne|osxwiking: and then put them on http://cloud.shogun-toolbox.org/17:32
sonne|osxto have the same thing we have on our homepage but more condensed17:33
shogun-buildbotbuild #2435 of deb1 - libshogun is complete: Failure [failed compile]  Build details are at http://buildbot.shogun-toolbox.org/builders/deb1%20-%20libshogun/builds/2435  blamelist: Soeren Sonnenburg <sonne@debian.org>, Koen van de Sande <koen@tibed.net>17:37
-!- sonne|osx [~sonne@82.113.99.211] has quit [Quit: sonne|osx]17:40
shogun-buildbotbuild #1926 of bsd1 - libshogun is complete: Failure [failed test]  Build details are at http://buildbot.shogun-toolbox.org/builders/bsd1%20-%20libshogun/builds/1926  blamelist: Koen van de Sande <koen@tibed.net>17:47
@wikingsonne|work: yep17:55
-!- iglesiasg [~iglesias@2001:6b0:1:1da0:e4f8:8e29:a992:b7df] has quit [Quit: Ex-Chat]17:55
-!- travis-ci [~travis-ci@ec2-54-211-90-234.compute-1.amazonaws.com] has joined #shogun18:22
travis-ci[travis-ci] it's Soeren Sonnenburg's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: http://travis-ci.org/shogun-toolbox/shogun/builds/1337134818:22
-!- travis-ci [~travis-ci@ec2-54-211-90-234.compute-1.amazonaws.com] has left #shogun []18:22
-!- thoralf [~thoralf@enki.zib.de] has quit [Quit: Konversation terminated!]18:23
shogun-buildbotbuild #2002 of deb3 - modular_interfaces is complete: Failure [failed test ruby modular]  Build details are at http://buildbot.shogun-toolbox.org/builders/deb3%20-%20modular_interfaces/builds/2002  blamelist: Koen van de Sande <koen@tibed.net>19:00
@sonney2kwiking, HeikoS good news from Gunnar!19:43
@sonney2khe intends to have a project developing software (ml algorithms...) that we don't yet have in shogun and that would be integrated at some point by his group19:43
@HeikoSsonney2k: very nice!19:48
@HeikoSgoing home. see you tomorrow!19:48
-!- HeikoS [~heiko@pat-191-250.internal.eduroam.ucl.ac.uk] has quit [Quit: Leaving.]19:48
shogun-notifier-shogun: Soeren Sonnenburg :develop * 4157057 / src/shogun/lib/SGVector.h: https://github.com/shogun-toolbox/shogun/commit/415705786bc1b0c17378f900110d7af16691d38620:13
shogun-notifier-shogun: add uint64_t index for access20:13
shogun-buildbotbuild #2436 of deb1 - libshogun is complete: Failure [failed compile]  Build details are at http://buildbot.shogun-toolbox.org/builders/deb1%20-%20libshogun/builds/2436  blamelist: Soeren Sonnenburg <sonne@debian.org>20:16
shogun-notifier-shogun: Soeren Sonnenburg :develop * e507019 / src/shogun/lib/SGVector.h: https://github.com/shogun-toolbox/shogun/commit/e5070190f505b4aaaa60e9b5aaa744932fd1448920:20
shogun-notifier-shogun: missing uint64_t access20:20
shogun-buildbotbuild #2437 of deb1 - libshogun is complete: Failure [failed compile]  Build details are at http://buildbot.shogun-toolbox.org/builders/deb1%20-%20libshogun/builds/2437  blamelist: Soeren Sonnenburg <sonne@debian.org>20:24
-!- travis-ci [~travis-ci@ec2-54-242-163-71.compute-1.amazonaws.com] has joined #shogun20:31
travis-ci[travis-ci] it's Soeren Sonnenburg's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: http://travis-ci.org/shogun-toolbox/shogun/builds/1337855620:31
-!- travis-ci [~travis-ci@ec2-54-242-163-71.compute-1.amazonaws.com] has left #shogun []20:31
-!- FSCV [~FSCV@50.7.50.60] has joined #shogun20:37
-!- travis-ci [~travis-ci@ec2-54-242-163-71.compute-1.amazonaws.com] has joined #shogun20:45
travis-ci[travis-ci] it's Soeren Sonnenburg's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: http://travis-ci.org/shogun-toolbox/shogun/builds/1337888220:45
-!- travis-ci [~travis-ci@ec2-54-242-163-71.compute-1.amazonaws.com] has left #shogun []20:45
-!- lisitsyn [~lisitsyn@109-226-82-69.clients.tlt.100megabit.ru] has joined #shogun20:57
lisitsynsonney2k: is it just some project that is going to be merged at some point or what?21:03
-!- iglesiasg [53b32c87@gateway/web/freenode/ip.83.179.44.135] has joined #shogun21:06
iglesiasghey21:06
iglesiasgsonney2k: so what are these algorithms that Gunnar's people are working on about?21:06
lisitsyniglesiasg: yeah I am interested too ;)21:09
iglesiasglisitsyn: cool! So do you know something about it?21:09
lisitsyniglesiasg: no21:09
iglesiasgJust out of curiosity21:09
iglesiasgall right, let's see what we find out then :)21:09
-!- iglesiasg [53b32c87@gateway/web/freenode/ip.83.179.44.135] has quit [Quit: Page closed]22:07
-!- FSCV [~FSCV@50.7.50.60] has quit [Quit: Leaving]22:52
-!- shogun-notifier- [~irker@7nn.de] has quit [Quit: transmission timeout]23:20
-!- HeikoS [~androirc@97e0a10b.skybroadband.com] has joined #shogun23:32
-!- mode/#shogun [+o HeikoS] by ChanServ23:32
@HeikoSHeikoS, .23:34
--- Log closed Sat Nov 02 00:00:07 2013