#ceph IRC Log

Index

IRC Log for 2016-08-12

Timestamps are in GMT/BST.

[0:04] * thansen (~thansen@17.253.sfcn.org) Quit (Quit: Ex-Chat)
[0:08] * georgem (~Adium@184.175.6.96) has joined #ceph
[0:08] * georgem (~Adium@184.175.6.96) Quit ()
[0:08] * georgem (~Adium@206.108.127.16) has joined #ceph
[0:08] * omg_im_dead (~omg_im_de@www.nisys.be) has joined #ceph
[0:09] <omg_im_dead> is there a way to extract the pgmap from an osd?
[0:11] * hrast_ (~hrast@cpe-24-55-26-86.austin.res.rr.com) has joined #ceph
[0:11] * ircolle (~Adium@2601:285:201:633a:1c8b:71f5:60f8:4f79) Quit (Quit: Leaving.)
[0:14] * hrast (~hrast@cpe-24-55-26-86.austin.res.rr.com) Quit (Ping timeout: 480 seconds)
[0:14] * hrast_ is now known as hrast
[0:16] * omg_im_dead (~omg_im_de@www.nisys.be) Quit (Remote host closed the connection)
[0:17] * omg_im_dead (~omg_im_de@www.nisys.be) has joined #ceph
[0:19] * stiopa (~stiopa@cpc73832-dals21-2-0-cust453.20-2.cable.virginm.net) Quit (Ping timeout: 480 seconds)
[0:23] * toastydeath (~toast@pool-71-255-253-39.washdc.fios.verizon.net) has joined #ceph
[0:25] * gila (~gila@5ED4FE92.cm-7-5d.dynamic.ziggo.nl) Quit (Quit: My Mac Pro has gone to sleep. ZZZzzz???)
[0:26] * xarses (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) has joined #ceph
[0:28] * bene2 (~bene@nat-pool-bos-t.redhat.com) Quit (Quit: Konversation terminated!)
[0:33] * rendar (~I@host50-34-dynamic.25-79-r.retail.telecomitalia.it) Quit (Quit: std::lower_bound + std::less_equal *works* with a vector without duplicates!)
[0:36] <dbbyleo> jdillaman: This URL is dead...
[0:36] <dbbyleo> http://docs.ceph.com/docs/master/radosgw/config
[0:36] <dbbyleo> and is found at the bottom of:
[0:36] <dbbyleo> http://docs.ceph.com/docs/master/start/quick-rgw/#configuring-the-ceph-object-gateway-instance
[0:36] <dbbyleo> just FYI
[0:46] * omg_im_dead (~omg_im_de@www.nisys.be) Quit (Remote host closed the connection)
[0:47] * omg_im_dead (~omg_im_de@www.nisys.be) has joined #ceph
[0:48] * bniver (~bniver@71-9-144-29.static.oxfr.ma.charter.com) Quit (Remote host closed the connection)
[0:51] * SEBI (~Scymex@torsrvu.snydernet.net) has joined #ceph
[0:57] * cathode (~cathode@50.232.215.114) Quit (Quit: Leaving)
[1:12] * gregmark (~Adium@68.87.42.115) Quit (Quit: Leaving.)
[1:16] * lxxl (~oftc-webi@localhost) has joined #ceph
[1:16] <lxxl> can anyone tell me where the command 'rbd list' gets its ip from? i have a healthy cluster after some ip changes and the monmap is ok but i still get 2016-08-11 23:13:57.758586 7f747c796700 0 -- 10.10.20.156:0/4011603036 >> 10.80.192.6:6800/1115 pipe(0x7f74a4921300 sd=4 :0 s=1 pgs=0 cs=0 l=1 c=0x7f74a4920080).fault
[1:16] <lxxl> its going to the wrong ip 10.80.192.6 so something is still not clean
[1:17] * fsimonce (~simon@host203-44-dynamic.183-80-r.retail.telecomitalia.it) Quit (Remote host closed the connection)
[1:20] * johnavp1989 (~jpetrini@8.39.115.8) Quit (Ping timeout: 480 seconds)
[1:21] * SEBI (~Scymex@61TAAA9O9.tor-irc.dnsbl.oftc.net) Quit ()
[1:30] * omg_im_dead (~omg_im_de@www.nisys.be) Quit (Remote host closed the connection)
[1:30] * omg_im_dead (~omg_im_de@www.nisys.be) has joined #ceph
[1:30] * Wizeon (~mr_flea@178-175-128-50.static.host) has joined #ceph
[1:33] * derjohn_mobi (~aj@x590cb994.dyn.telefonica.de) Quit (Ping timeout: 480 seconds)
[1:44] * danieagle (~Daniel@200-100-212-200.dial-up.telesp.net.br) Quit (Quit: Obrigado por Tudo! :-) inte+ :-))
[1:44] * oms101 (~oms101@p20030057EA01D600C6D987FFFE4339A1.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[1:45] * omg_im_dead (~omg_im_de@www.nisys.be) Quit (Remote host closed the connection)
[1:45] * Vaelatern (~Vaelatern@cvgateway.utdallas.edu) has joined #ceph
[1:46] * gila (~gila@5ED4FE92.cm-7-5d.dynamic.ziggo.nl) has joined #ceph
[1:48] * ronrib (~boswortr@45.32.242.135) Quit (Ping timeout: 480 seconds)
[1:53] * oms101 (~oms101@p20030057EA020C00C6D987FFFE4339A1.dip0.t-ipconnect.de) has joined #ceph
[2:00] * Wizeon (~mr_flea@5AEAAAXHA.tor-irc.dnsbl.oftc.net) Quit ()
[2:02] * georgem (~Adium@206.108.127.16) Quit (Quit: Leaving.)
[2:03] * wushudoin (~wushudoin@2601:646:8281:cfd:2ab2:bdff:fe0b:a6ee) Quit (Ping timeout: 480 seconds)
[2:12] * neurodrone (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) has joined #ceph
[2:14] * sudocat (~dibarra@192.185.1.20) Quit (Ping timeout: 480 seconds)
[2:21] * xarses_ (~xarses@static-208.78.244.200.nephosdns.com) has joined #ceph
[2:28] * xarses (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[2:33] * wgao (~wgao@106.120.101.38) Quit (Ping timeout: 480 seconds)
[2:38] * vasu (~vasu@c-73-231-60-138.hsd1.ca.comcast.net) Quit (Quit: Leaving)
[2:42] * chunmei (~chunmei@134.134.137.75) Quit (Ping timeout: 480 seconds)
[2:45] * wgao (~wgao@106.120.101.38) has joined #ceph
[3:06] * Nacer (~Nacer@vir78-1-82-232-38-190.fbx.proxad.net) has joined #ceph
[3:07] * chengpeng_ (~chengpeng@180.168.170.2) has joined #ceph
[3:14] * chengpeng__ (~chengpeng@180.168.126.179) Quit (Ping timeout: 480 seconds)
[3:24] * Nacer (~Nacer@vir78-1-82-232-38-190.fbx.proxad.net) Quit (Remote host closed the connection)
[3:25] * wak-work (~wak-work@2620:15c:202:0:4d68:fd7b:61d9:5e9a) Quit (Remote host closed the connection)
[3:26] * wak-work (~wak-work@2620:15c:202:0:59e8:4eec:f70f:8bfe) has joined #ceph
[3:30] * EinstCrazy (~EinstCraz@58.247.119.250) has joined #ceph
[3:34] * yanzheng (~zhyan@125.70.22.133) has joined #ceph
[3:40] * sebastian-w (~quassel@212.218.8.138) Quit (Read error: Connection reset by peer)
[3:40] * sebastian-w (~quassel@212.218.8.139) has joined #ceph
[3:44] * srk_ (~Siva@cpe-70-113-23-93.austin.res.rr.com) has joined #ceph
[3:48] * brianjjo (~Random@108.61.68.148) has joined #ceph
[3:55] * neurodrone (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) Quit (Quit: neurodrone)
[3:55] * lxxl (~oftc-webi@localhost) Quit (Ping timeout: 480 seconds)
[3:57] * kefu (~kefu@114.92.99.82) has joined #ceph
[4:06] * janos (~messy@static-71-176-211-4.rcmdva.fios.verizon.net) has joined #ceph
[4:17] * shaunm (~shaunm@5.158.137.118) Quit (Read error: Connection reset by peer)
[4:18] * brianjjo (~Random@108.61.68.148) Quit ()
[4:24] * jfaj_ (~jan@p20030084AF3449005EC5D4FFFEBB68A4.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[4:33] * srk_ (~Siva@cpe-70-113-23-93.austin.res.rr.com) Quit (Read error: Connection reset by peer)
[4:33] * jfaj_ (~jan@p20030084AF3412005EC5D4FFFEBB68A4.dip0.t-ipconnect.de) has joined #ceph
[4:33] * srk_ (~Siva@2605:6000:ed04:ce00:2883:996d:a9d7:e009) has joined #ceph
[4:37] * neurodrone (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) has joined #ceph
[4:39] * EinstCrazy (~EinstCraz@58.247.119.250) Quit (Remote host closed the connection)
[4:40] * srk (~Siva@cpe-70-113-23-93.austin.res.rr.com) has joined #ceph
[4:42] * vicente (~~vicente@125-227-238-55.HINET-IP.hinet.net) has joined #ceph
[4:43] * EinstCrazy (~EinstCraz@58.247.117.134) has joined #ceph
[4:45] * chengpeng_ (~chengpeng@180.168.170.2) Quit (Read error: Connection reset by peer)
[4:45] * chengpeng_ (~chengpeng@180.168.126.243) has joined #ceph
[4:46] * srk_ (~Siva@2605:6000:ed04:ce00:2883:996d:a9d7:e009) Quit (Ping timeout: 480 seconds)
[4:51] * Nicho1as (~nicho1as@00022427.user.oftc.net) has joined #ceph
[4:54] * ggg (~Rens2Sea@46.166.137.245) has joined #ceph
[5:03] * srk (~Siva@cpe-70-113-23-93.austin.res.rr.com) Quit (Read error: Connection reset by peer)
[5:03] * srk (~Siva@cpe-70-113-23-93.austin.res.rr.com) has joined #ceph
[5:13] * georgem (~Adium@184-175-6-96.dsl.teksavvy.com) has joined #ceph
[5:14] * georgem (~Adium@184-175-6-96.dsl.teksavvy.com) Quit ()
[5:14] * georgem (~Adium@206.108.127.16) has joined #ceph
[5:14] * Pulp (~Pulp@63-221-50-195.dyn.estpak.ee) Quit (Ping timeout: 480 seconds)
[5:18] * srk (~Siva@cpe-70-113-23-93.austin.res.rr.com) Quit (Read error: Connection reset by peer)
[5:18] * srk (~Siva@cpe-70-113-23-93.austin.res.rr.com) has joined #ceph
[5:24] * ggg (~Rens2Sea@26XAAAZ8N.tor-irc.dnsbl.oftc.net) Quit ()
[5:29] * EinstCra_ (~EinstCraz@58.247.119.250) has joined #ceph
[5:30] * penguinRaider (~KiKo@146.185.31.226) Quit (Ping timeout: 480 seconds)
[5:35] * EinstCrazy (~EinstCraz@58.247.117.134) Quit (Ping timeout: 480 seconds)
[5:35] * Vacuum_ (~Vacuum@88.130.223.147) has joined #ceph
[5:38] * N3X15 (~Popz@89.45.226.28) has joined #ceph
[5:38] * penguinRaider (~KiKo@182.18.155.15) has joined #ceph
[5:42] * Vacuum__ (~Vacuum@88.130.203.172) Quit (Ping timeout: 480 seconds)
[5:46] * davidzlap (~Adium@2605:e000:1313:8003:e5e5:2192:fa28:3054) Quit (Quit: Leaving.)
[5:46] * davidzlap (~Adium@2605:e000:1313:8003:e5e5:2192:fa28:3054) has joined #ceph
[5:48] * srk (~Siva@cpe-70-113-23-93.austin.res.rr.com) Quit (Read error: Connection reset by peer)
[5:50] * georgem (~Adium@206.108.127.16) Quit (Quit: Leaving.)
[5:51] * srk (~Siva@cpe-70-113-23-93.austin.res.rr.com) has joined #ceph
[5:54] * vimal (~vikumar@114.143.165.8) has joined #ceph
[5:55] * davidzlap (~Adium@2605:e000:1313:8003:e5e5:2192:fa28:3054) Quit (Quit: Leaving.)
[6:01] * walcubi_ (~walcubi@p5797A0B6.dip0.t-ipconnect.de) has joined #ceph
[6:03] * srk (~Siva@cpe-70-113-23-93.austin.res.rr.com) Quit (Ping timeout: 480 seconds)
[6:05] * neurodrone (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) Quit (Quit: neurodrone)
[6:07] * vimal (~vikumar@114.143.165.8) Quit (Quit: Leaving)
[6:08] * N3X15 (~Popz@9YSAABAN0.tor-irc.dnsbl.oftc.net) Quit ()
[6:08] * walcubi (~walcubi@p5795BF9D.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[6:16] * kefu (~kefu@114.92.99.82) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[6:19] * hrast (~hrast@cpe-24-55-26-86.austin.res.rr.com) Quit (Quit: hrast)
[6:21] * vicente_ (~~vicente@125-227-238-55.HINET-IP.hinet.net) has joined #ceph
[6:21] * vicente (~~vicente@125-227-238-55.HINET-IP.hinet.net) Quit (Read error: Connection reset by peer)
[6:28] * vimal (~vikumar@121.244.87.116) has joined #ceph
[6:29] * nils_ (~nils_@doomstreet.collins.kg) Quit (Quit: This computer has gone to sleep)
[6:35] * kefu (~kefu@114.92.99.82) has joined #ceph
[6:39] <masber> hi
[6:39] <masber> I found this pdf on the net which is quite interesting
[6:39] <masber> https://www.msi.umn.edu/sites/default/files/MN_RH_BOFSC15.pdf
[6:39] <masber> just sharing if anyone interested
[6:41] * vikhyat (~vumrao@121.244.87.116) has joined #ceph
[6:51] * TomasCZ (~TomasCZ@yes.tenlab.net) Quit (Quit: Leaving)
[7:01] * rdas (~rdas@121.244.87.116) has joined #ceph
[7:18] * ira (~ira@121.244.87.118) has joined #ceph
[7:26] * ira (~ira@121.244.87.118) Quit (Quit: Leaving)
[7:27] * tritonx (~xanax`@torland1-this.is.a.tor.exit.server.torland.is) has joined #ceph
[7:34] * swami1 (~swami@49.44.57.242) has joined #ceph
[7:35] * karnan (~karnan@2405:204:5009:8faf:3602:86ff:fe56:55ae) has joined #ceph
[7:37] * swami2 (~swami@49.38.0.204) has joined #ceph
[7:37] * swami2 (~swami@49.38.0.204) has left #ceph
[7:37] * swami2 (~swami@49.38.0.204) has joined #ceph
[7:42] * swami1 (~swami@49.44.57.242) Quit (Ping timeout: 480 seconds)
[7:54] * swami2 (~swami@49.38.0.204) Quit (Read error: Connection timed out)
[7:57] * tritonx (~xanax`@61TAAA9XC.tor-irc.dnsbl.oftc.net) Quit ()
[8:03] * branto (~branto@ip-78-102-208-181.net.upcbroadband.cz) has joined #ceph
[8:05] * Be-El (~blinke@nat-router.computational.bio.uni-giessen.de) has joined #ceph
[8:15] * linuxkidd (~linuxkidd@ip70-189-207-54.lv.lv.cox.net) Quit (Quit: Leaving)
[8:27] <masber> I would like to meassure the IOPs of my storage appliance under different loads scenarios, are IOR and FIO the bests tools for that?
[8:30] * treenerd_ (~gsulzberg@cpe90-146-148-47.liwest.at) has joined #ceph
[8:31] * derjohn_mobi (~aj@x4db11684.dyn.telefonica.de) has joined #ceph
[8:32] * karnan (~karnan@2405:204:5009:8faf:3602:86ff:fe56:55ae) Quit (Ping timeout: 480 seconds)
[8:33] <badone> masber: have a look at slide 3 here, http://www.slideshare.net/Inktank_Ceph/ceph-day-melbourne-troubleshooting-ceph
[8:34] <masber> badone: thank you! I will have a look
[8:36] <badone> masber: be aware that you need multiple parallel tests to truly see what ceph is capable of, single threaded tests don't really cut it
[8:36] <badone> ceph thrives on many concurrent connections distributed across the members of the cluster
[8:37] <masber> yeah, I am going to use several clients at the same time for my tests
[8:37] <masber> first I need to read how these tools works and then I will organize the clients
[8:37] <badone> masber: there are multiple published test results as we discussed yesterday which are worth looking at
[8:38] <badone> masber: take a look at CBT first
[8:38] <badone> it wraps some of the other tools
[8:38] <masber> yeah I saw the links you sent me plus others, thank you they were very useful
[8:38] <badone> np
[8:39] <badone> also keep in mind that a single slow component can wreak havoc with performance
[8:39] <badone> good luck! :)
[8:41] <masber> yeah, I am a bit scared as performance test are very hard to to do but anyway I at the moment I want to test first our current storage system (Panasas) and then see if ceph would outperforms
[8:41] <masber> thank you
[8:41] * vicente_ (~~vicente@125-227-238-55.HINET-IP.hinet.net) has left #ceph
[8:41] * wjw-freebsd (~wjw@smtp.digiware.nl) Quit (Ping timeout: 480 seconds)
[8:41] * vicente (~~vicente@125-227-238-55.HINET-IP.hinet.net) has joined #ceph
[8:45] <badone> masber: have a look at the mailing list (mentioned on the website) for what other people have tried, and have acheived. The ML is a good resource if you need help too
[8:45] * rendar (~I@host35-177-dynamic.42-79-r.retail.telecomitalia.it) has joined #ceph
[8:46] <masber> will do
[9:20] * rotbeard (~redbeard@185.32.80.238) has joined #ceph
[9:23] * wjw-freebsd (~wjw@80.255.245.232) has joined #ceph
[9:25] * karnan (~karnan@121.244.87.117) has joined #ceph
[9:31] * post-factum (~post-fact@vulcan.natalenko.name) Quit (Killed (NickServ (Too many failed password attempts.)))
[9:31] * post-factum (~post-fact@vulcan.natalenko.name) has joined #ceph
[9:38] * T1w (~jens@node3.survey-it.dk) has joined #ceph
[9:39] * benner (~benner@188.166.111.206) Quit (Remote host closed the connection)
[9:39] * fsimonce (~simon@host203-44-dynamic.183-80-r.retail.telecomitalia.it) has joined #ceph
[9:43] * sw3 (sweaung@2400:6180:0:d0::66:100f) Quit (Ping timeout: 480 seconds)
[9:43] * sw3 (sweaung@2400:6180:0:d0::66:100f) has joined #ceph
[9:46] * getup (~getup@095-097-074-074.static.chello.nl) has joined #ceph
[9:55] * TMM (~hp@188.200.6.137) Quit (Ping timeout: 480 seconds)
[9:59] * Pirate (~shishi@torrelay4.tomhek.net) has joined #ceph
[10:02] * doppelgrau (~doppelgra@dslb-088-072-094-200.088.072.pools.vodafone-ip.de) Quit (Quit: doppelgrau)
[10:12] * bara (~bara@nat-pool-brq-t.redhat.com) has joined #ceph
[10:13] * ade (~abradshaw@p4FF79F5F.dip0.t-ipconnect.de) has joined #ceph
[10:18] * evelu (~erwan@poo40-1-78-231-184-196.fbx.proxad.net) has joined #ceph
[10:20] * evelu (~erwan@poo40-1-78-231-184-196.fbx.proxad.net) Quit (Remote host closed the connection)
[10:22] * evelu (~erwan@poo40-1-78-231-184-196.fbx.proxad.net) has joined #ceph
[10:25] * analbeard (~shw@support.memset.com) has joined #ceph
[10:26] * rakeshgm (~rakesh@121.244.87.117) has joined #ceph
[10:29] * Pirate (~shishi@61TAAA9Z1.tor-irc.dnsbl.oftc.net) Quit ()
[10:47] * doppelgrau (~doppelgra@132.252.235.172) has joined #ceph
[10:50] * ade (~abradshaw@p4FF79F5F.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[10:56] * rakeshgm (~rakesh@121.244.87.117) Quit (Ping timeout: 480 seconds)
[10:59] * derjohn_mobi (~aj@x4db11684.dyn.telefonica.de) Quit (Ping timeout: 480 seconds)
[11:00] * Revo84 (~Snowcat4@torland1-this.is.a.tor.exit.server.torland.is) has joined #ceph
[11:01] * ade (~abradshaw@p4FF79F5F.dip0.t-ipconnect.de) has joined #ceph
[11:04] * kefu (~kefu@114.92.99.82) Quit (Max SendQ exceeded)
[11:05] * kefu (~kefu@45.32.49.168) has joined #ceph
[11:06] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:f01f:657e:17e3:bfd5) has joined #ceph
[11:09] * dgurtner (~dgurtner@84-73-130-19.dclient.hispeed.ch) has joined #ceph
[11:14] * bara (~bara@nat-pool-brq-t.redhat.com) Quit (Remote host closed the connection)
[11:17] * roeland (~roeland@77.108.157.165) has joined #ceph
[11:17] <roeland> hi
[11:17] * bara (~bara@nat-pool-brq-t.redhat.com) has joined #ceph
[11:17] * garphy`aw is now known as garphy
[11:18] <roeland> just a quick question, is there an easy way to tell what the contents of a PG are ? we've got a pg that's broken but we need to check which bits of data are affected before we mark it as lost
[11:19] <Be-El> you can derive the content from the filenames
[11:19] * ira (~ira@121.244.87.118) has joined #ceph
[11:21] <roeland> you mean in the mounted /var/lib/ceph/osd/ceph-xxx/current/pgidxxx/ ?
[11:21] <Be-El> exactly
[11:22] <Be-El> if the pg is broken it is difficult to list its content otherwise
[11:22] <roeland> slight problem with that, I'm not sure what default.4282484.12\ub5135ef8711422656f7f172341c1682e__head_9D7EFA18__3f_ffffffffffffffff_9 for example relates to real data wise :)
[11:24] <Be-El> well, "rbd\udata...." relates to rbd image chunks, "1000XXXXXXXX.XXXXXX..." are cephfs file chunks on our system
[11:25] <Be-El> the pattern looks like a rgw data pool
[11:25] <roeland> aha
[11:25] <Be-El> eh...nope, those look different on our system
[11:26] * DanFoster (~Daniel@office.34sp.com) has joined #ceph
[11:26] <roeland> we're also using EC so that may be a factor
[11:26] <Be-El> but it is probably related to rgw
[11:26] <Be-El> default.1313263.2\u\ushadow\udatabase.idx.2~eqDgKVuCpikf-Nw-mw9f5ZOaFNkmow\u.76\u1__head_532ECD21__1c
[11:26] <Be-El> that's a file in a rgw bucket pool
[11:27] <roeland> well at least now I can find the rados objects, thanks for that. Now to figure out how that relates to the application :)
[11:27] * essjayhch (uid79416@id-79416.highgate.irccloud.com) has joined #ceph
[11:27] <roeland> thank you
[11:28] * rraja (~rraja@121.244.87.117) Quit (Remote host closed the connection)
[11:30] * Revo84 (~Snowcat4@5AEAAAXQM.tor-irc.dnsbl.oftc.net) Quit ()
[11:30] * rraja (~rraja@121.244.87.117) has joined #ceph
[11:43] * derjohn_mobi (~aj@2001:6f8:1337:0:845d:8d8b:b673:fcdd) has joined #ceph
[11:57] * TGF (~SEBI@torland1-this.is.a.tor.exit.server.torland.is) has joined #ceph
[12:00] * toastyde1th (~toast@pool-71-255-253-39.washdc.fios.verizon.net) has joined #ceph
[12:05] * EinstCra_ (~EinstCraz@58.247.119.250) Quit (Remote host closed the connection)
[12:06] * treenerd_ (~gsulzberg@cpe90-146-148-47.liwest.at) Quit (Quit: treenerd_)
[12:06] * IvanJobs (~ivanjobs@103.50.11.146) Quit ()
[12:06] * toastydeath (~toast@pool-71-255-253-39.washdc.fios.verizon.net) Quit (Ping timeout: 480 seconds)
[12:08] * kefu_ (~kefu@114.92.99.82) has joined #ceph
[12:11] * kefu (~kefu@45.32.49.168) Quit (Ping timeout: 480 seconds)
[12:21] * newbie (~kvirc@host217-114-156-249.pppoe.mark-itt.net) has joined #ceph
[12:25] * thomnico (~thomnico@2a01:e35:8b41:120:d491:7abc:d665:4d84) has joined #ceph
[12:27] <hellertime> so I have a 5 node mds setup. with 'ceph mds dump' things look ok. 1 active, 1 standby-replay, 3 standby mds. but if I run 'ceph daemon mds.X status' on any of the mds, they all say they are in state 'up:active'!?
[12:27] * TGF (~SEBI@9YSAABARC.tor-irc.dnsbl.oftc.net) Quit ()
[12:27] * Oddtwang (~PeterRabb@5.153.234.90) has joined #ceph
[12:32] <hellertime> should I trust the 'mds dump' output or the 'daemon status' output here? this is 0.94.3 btw
[12:32] * getup (~getup@095-097-074-074.static.chello.nl) Quit (Quit: My MacBook Pro has gone to sleep. ZZZzzz???)
[12:33] * getup (~getup@095-097-074-074.static.chello.nl) has joined #ceph
[12:43] * Pulp (~Pulp@63-221-50-195.dyn.estpak.ee) has joined #ceph
[12:47] * wjw-freebsd (~wjw@80.255.245.232) Quit (Ping timeout: 480 seconds)
[12:48] * ira (~ira@121.244.87.118) Quit (Ping timeout: 480 seconds)
[12:56] * getup (~getup@095-097-074-074.static.chello.nl) Quit (Quit: My MacBook Pro has gone to sleep. ZZZzzz???)
[12:57] * Oddtwang (~PeterRabb@5.153.234.90) Quit ()
[12:58] * vicente (~~vicente@125-227-238-55.HINET-IP.hinet.net) Quit (Quit: Leaving)
[13:01] * rotbeard (~redbeard@185.32.80.238) Quit (Quit: Leaving)
[13:07] * kefu_ is now known as kefu
[13:09] * neurodrone (~neurodron@162.243.191.67) has joined #ceph
[13:11] * getup (~getup@095-097-074-074.static.chello.nl) has joined #ceph
[13:30] * bene2 (~bene@2601:193:4101:f410:ea2a:eaff:fe08:3c7a) has joined #ceph
[13:32] * kefu (~kefu@114.92.99.82) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[13:32] * TMM (~hp@178-84-46-106.dynamic.upc.nl) has joined #ceph
[13:33] * TomyLobo (~DougalJac@46.166.186.215) has joined #ceph
[13:36] * kefu (~kefu@114.92.99.82) has joined #ceph
[13:37] * pfactum (~post-fact@vulcan.natalenko.name) has joined #ceph
[13:37] * william__ (~wkenningt@c-71-204-170-241.hsd1.ca.comcast.net) has joined #ceph
[13:38] * bniver (~bniver@71-9-144-29.static.oxfr.ma.charter.com) has joined #ceph
[13:38] * post-factum (~post-fact@vulcan.natalenko.name) Quit (Read error: Connection reset by peer)
[13:38] * janos_ (~messy@static-71-176-211-4.rcmdva.fios.verizon.net) has joined #ceph
[13:38] * Racpatel (~Racpatel@2601:87:0:24af::53d5) Quit (Read error: Connection reset by peer)
[13:38] * pfactum is now known as post-factum
[13:39] * kefu (~kefu@114.92.99.82) Quit ()
[13:40] * bene2 (~bene@2601:193:4101:f410:ea2a:eaff:fe08:3c7a) Quit (Remote host closed the connection)
[13:40] * bene2 (~bene@2601:193:4101:f410:ea2a:eaff:fe08:3c7a) has joined #ceph
[13:41] * Racpatel (~Racpatel@2601:87:0:24af::53d5) has joined #ceph
[13:44] * Meths_ is now known as Meths
[13:44] * wkennington_ (~wkenningt@c-71-204-170-241.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[13:44] * janos (~messy@static-71-176-211-4.rcmdva.fios.verizon.net) Quit (Ping timeout: 480 seconds)
[13:50] * newbie (~kvirc@host217-114-156-249.pppoe.mark-itt.net) Quit (Ping timeout: 480 seconds)
[13:51] * jfaj_ (~jan@p20030084AF3412005EC5D4FFFEBB68A4.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[13:51] * nils_ (~nils_@doomstreet.collins.kg) has joined #ceph
[14:02] * treenerd_ (~gsulzberg@cpe90-146-148-47.liwest.at) has joined #ceph
[14:02] * jfaj_ (~jan@p20030084AF0B50005EC5D4FFFEBB68A4.dip0.t-ipconnect.de) has joined #ceph
[14:03] * TomyLobo (~DougalJac@46.166.186.215) Quit ()
[14:03] * Diablodoct0r (~aleksag@torland1-this.is.a.tor.exit.server.torland.is) has joined #ceph
[14:07] * ivve (~zed@cust-gw-11.se.zetup.net) has joined #ceph
[14:08] * karnan (~karnan@121.244.87.117) Quit (Remote host closed the connection)
[14:20] * georgem (~Adium@24.114.64.73) has joined #ceph
[14:20] * georgem (~Adium@24.114.64.73) Quit ()
[14:21] * georgem (~Adium@206.108.127.16) has joined #ceph
[14:22] * getup (~getup@095-097-074-074.static.chello.nl) Quit (Quit: My MacBook Pro has gone to sleep. ZZZzzz???)
[14:25] * roeland (~roeland@77.108.157.165) Quit (Quit: leaving)
[14:28] * owasserm (~owasserm@2001:984:d3f7:1:5ec5:d4ff:fee0:f6dc) Quit (Remote host closed the connection)
[14:31] * owasserm (~owasserm@2001:984:d3f7:1:5ec5:d4ff:fee0:f6dc) has joined #ceph
[14:32] * getup (~getup@095-097-074-074.static.chello.nl) has joined #ceph
[14:33] * Diablodoct0r (~aleksag@26XAAA0KF.tor-irc.dnsbl.oftc.net) Quit ()
[14:33] * Pulp (~Pulp@63-221-50-195.dyn.estpak.ee) Quit (Read error: Connection reset by peer)
[14:38] * georgem (~Adium@206.108.127.16) Quit (Ping timeout: 480 seconds)
[14:47] * danielsj (~pepzi@ip95.ip-94-23-150.eu) has joined #ceph
[14:49] * georgem (~Adium@206.108.127.16) has joined #ceph
[14:57] * [0x4A6F]_ (~ident@p508CD2C9.dip0.t-ipconnect.de) has joined #ceph
[14:58] * roeland (~roeland@77.108.157.165) has joined #ceph
[14:59] * rwheeler (~rwheeler@pool-173-48-195-215.bstnma.fios.verizon.net) has joined #ceph
[15:02] * [0x4A6F] (~ident@0x4a6f.user.oftc.net) Quit (Ping timeout: 480 seconds)
[15:02] * [0x4A6F]_ is now known as [0x4A6F]
[15:02] * mattbenjamin (~mbenjamin@12.118.3.106) has joined #ceph
[15:04] * johnavp1989 (~jpetrini@8.39.115.8) has joined #ceph
[15:04] <- *johnavp1989* To prove that you are human, please enter the result of 8+3
[15:05] * kefu (~kefu@114.92.99.82) has joined #ceph
[15:07] * mhack (~mhack@24-151-36-149.dhcp.nwtn.ct.charter.com) has joined #ceph
[15:12] * vimal (~vikumar@121.244.87.116) Quit (Quit: Leaving)
[15:16] * vimal (~vikumar@121.244.87.116) has joined #ceph
[15:17] * danielsj (~pepzi@9YSAABATK.tor-irc.dnsbl.oftc.net) Quit ()
[15:18] * walcubi_ is now known as walbuci
[15:19] <walbuci> Alright, I now have loaded live data into a storage pool. 605GB with 80M objects. :-)
[15:20] <walbuci> SSDs seem like the only viable kind of OSD for this.
[15:21] * neobenedict (~Vale@torland1-this.is.a.tor.exit.server.torland.is) has joined #ceph
[15:22] * squizzi (~squizzi@71-34-69-94.ptld.qwest.net) has joined #ceph
[15:23] <walbuci> I'm just looking at our request times, and I'm seeing between 5-11ms for HTTP 200's.
[15:24] <walbuci> And between 4-8ms for HTTP 304 and 404's
[15:24] <roeland> anyone have suggestions for dealing with an utterly broken incomplete pg ?
[15:26] <walbuci> This is nginx + rados_stat() + rados_read(). Which fair up quite good compared to local SSDs, which are 2-3ms and 1-2ms respectively.
[15:26] * vimal (~vikumar@121.244.87.116) Quit (Quit: Leaving)
[15:27] <hellertime> why does a pg get 'stuck unclean' if its acting OSD are all up, its being blocked by a down OSD not in the acting set.
[15:28] * T1w (~jens@node3.survey-it.dk) Quit (Ping timeout: 480 seconds)
[15:28] <walbuci> Leaving it overnight, however I see that things start to go wild with request times. Anywhere between 4-55ms !!!
[15:28] <walbuci> I've tracked it down to what looks like a daily scrub that is running in the background.
[15:29] * brad_mssw (~brad@66.129.88.50) has joined #ceph
[15:30] * rotbeard (~redbeard@185.32.80.238) has joined #ceph
[15:30] * pam (~pam@193.106.183.1) has joined #ceph
[15:30] <pam> Hi all!
[15:30] <walbuci> Are there any general tips for limiting the impact for latency sensitive clients? Every millisecond lost could mean a missing the delivery window.
[15:30] <hellertime> here is the pg query: http://pastebin.com/Rg2hK9GE
[15:31] <pam> we just updated our cluster from hammer to jewel and now calamari is not displaying Pool IO/s and Pool performance data. Any clues?
[15:32] <pam> It seems monitor related since all storage nodes are reporting cpu/network etc. usage
[15:32] <georgem> walbuci: are you accessing the files over https? are they in different buckets? how many files per bucket? how many rgw?
[15:34] * kefu (~kefu@114.92.99.82) Quit (Max SendQ exceeded)
[15:35] * kefu (~kefu@114.92.99.82) has joined #ceph
[15:38] * racpatel__ (~Racpatel@2601:87:0:24af:4e34:88ff:fe87:9abf) has joined #ceph
[15:38] * Racpatel (~Racpatel@2601:87:0:24af::53d5) Quit (Ping timeout: 480 seconds)
[15:38] * racpatel__ (~Racpatel@2601:87:0:24af:4e34:88ff:fe87:9abf) Quit ()
[15:38] * Racpatel (~Racpatel@2601:87:0:24af:4e34:88ff:fe87:9abf) has joined #ceph
[15:40] * dennis_ (~dennis@2a00:801:7:1:1a03:73ff:fed6:ffec) Quit (Quit: L??mnar)
[15:40] * Racpatel (~Racpatel@2601:87:0:24af:4e34:88ff:fe87:9abf) Quit (Read error: Connection reset by peer)
[15:40] * Racpatel (~Racpatel@2601:87:0:24af::53d5) has joined #ceph
[15:41] * yanzheng (~zhyan@125.70.22.133) Quit (Quit: This computer has gone to sleep)
[15:43] * danieagle (~Daniel@200-100-212-200.dial-up.telesp.net.br) has joined #ceph
[15:45] * rraja (~rraja@121.244.87.117) Quit (Ping timeout: 480 seconds)
[15:51] * neobenedict (~Vale@26XAAA0NK.tor-irc.dnsbl.oftc.net) Quit ()
[15:52] <walbuci> georgem, Over http (all transactions are happening over an internal 1Gbit network). All objects are in the same pool. There are 80 million objects in this pool for this release-test (note, we have around 1,280 million objects in production). There are no rgws, this is just one server running nginx out of 16 which are handling requests by a file range.
[16:01] <walbuci> I see there is ioprio settings, though require cfq scheduler.
[16:01] <walbuci> I don't recall of the top of my head if cfq is a good idea for SSDs.
[16:02] <walbuci> I would assume no.
[16:02] * pam (~pam@193.106.183.1) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[16:02] * bara (~bara@nat-pool-brq-t.redhat.com) Quit (Ping timeout: 480 seconds)
[16:03] * thomnico (~thomnico@2a01:e35:8b41:120:d491:7abc:d665:4d84) Quit (Quit: Ex-Chat)
[16:03] * branto (~branto@ip-78-102-208-181.net.upcbroadband.cz) Quit (Ping timeout: 480 seconds)
[16:08] * doppelgrau (~doppelgra@132.252.235.172) Quit (Quit: Leaving.)
[16:10] * xarses_ (~xarses@static-208.78.244.200.nephosdns.com) Quit (Ping timeout: 480 seconds)
[16:11] <dbbyleo> I'm having issues with rbdmap. I have the following entry in my /etc/ceph/rbdmap:
[16:11] <dbbyleo> rbd/cephdd id=client.admin,keyring=/etc/ceph/ceph.client.admin.keyring
[16:11] <dbbyleo> journalctl shows this error:
[16:11] <dbbyleo> Aug 12 08:07:17 cephcl rbdmap[926]: /usr/bin/rbdmap: 32: /usr/bin/rbdmap: Bad substitution
[16:12] * vikhyat (~vumrao@121.244.87.116) Quit (Quit: Leaving)
[16:14] * bara (~bara@213.175.37.12) has joined #ceph
[16:14] <dbbyleo> leseb: I just recognized your name from the blog I was just reading on rbdmap to auto map my block devices...
[16:15] * branto (~branto@ip-78-102-208-181.net.upcbroadband.cz) has joined #ceph
[16:15] <leseb> dbbyleo hey, can you at least map manually?
[16:15] * kefu (~kefu@114.92.99.82) Quit (Max SendQ exceeded)
[16:15] <dbbyleo> yes I can
[16:15] <dbbyleo> mapped and mounted manually works fine
[16:16] * kefu (~kefu@114.92.99.82) has joined #ceph
[16:16] <dbbyleo> your blog says to wget the script, but I already had it after installing jewel.
[16:17] <dbbyleo> tere isn't much info about the paraeter field in the /etc/ceph/rbdmap file...
[16:18] <dbbyleo> so I just followed your example... assume ID= and keyring= corresponds to my keyring file.
[16:18] <leseb> dbbyleo do you also have the unit file? https://github.com/ceph/ceph/blob/master/systemd/rbdmap.service
[16:19] <leseb> dbbyleo if you use systemd, i'd rather use the unit file
[16:19] <dbbyleo> Not sure how to check that, but I can: sudo systemctl status rbdmap
[16:19] <dbbyleo> and it comes back with a status...
[16:19] <dbbyleo> is that what you mean?
[16:20] <leseb> then you are not using the script from the article which is a good thing
[16:22] <dbbyleo> so what do you think that error means?
[16:22] <dbbyleo> It doesn't like my entry in the rbdmap file...
[16:22] * wes_dillingham (~wes_dilli@140.247.242.44) has joined #ceph
[16:23] <dbbyleo> "bad substitution" however sounds like an unhandled exception in the script...
[16:24] <leseb> dbbyleo yes sounds really generic to me
[16:24] <leseb> your conf looks just fine
[16:24] <leseb> let me try
[16:24] <dbbyleo> my keyring file just has [client.admin]
[16:24] <dbbyleo> so that's what I put in the ID=
[16:26] <leseb> dbbyleo ah wait
[16:26] <leseb> id=admin
[16:26] <leseb> not client.admin
[16:27] <dbbyleo> really? what should it be?
[16:27] <leseb> id=admin and name=client.admin
[16:27] <roeland> anyone have suggestions for dealing with an utterly broken incomplete pg ? (erasure coded pool but not enough shards remain for recovery)
[16:27] <leseb> so this gives you "id=admin,keyring=/etc/ceph/ceph.client.admin.keyring"
[16:27] <leseb> dbbyleo try that ^
[16:27] * ahmeni (~AGaW@torland1-this.is.a.tor.exit.server.torland.is) has joined #ceph
[16:27] <dbbyleo> ok standby
[16:28] <dbbyleo> same error :(
[16:29] <dbbyleo> rbd/cephdd id=admin,keyring=/etc/ceph/ceph.client.admin.keyring
[16:30] <dbbyleo> mapping manually with this work fine:
[16:30] <dbbyleo> sudo rbd map -p rbd cephdd
[16:32] <dbbyleo> cephadmin@cephcl:~$ cat /etc/ceph/ceph.client.admin.keyring
[16:32] <dbbyleo> [client.admin]
[16:32] <dbbyleo> key = XXXXX my key XXXXXX
[16:35] <leseb> dbbyleo can you do rbd --id admin -k /etc/ceph/ceph.client.admin.keyring map -p rbd cephdd
[16:36] <leseb> this should do the same thing but just to be sure
[16:36] <dbbyleo> ok I'll unmap first and then try
[16:36] * xarses_ (~xarses@64.124.158.32) has joined #ceph
[16:37] <dbbyleo> yup - that works too
[16:37] * kefu (~kefu@114.92.99.82) Quit (Max SendQ exceeded)
[16:38] * sudocat (~dibarra@104-188-116-197.lightspeed.hstntx.sbcglobal.net) has joined #ceph
[16:38] * kefu (~kefu@114.92.99.82) has joined #ceph
[16:39] * davidzlap (~Adium@rrcs-74-87-213-28.west.biz.rr.com) has joined #ceph
[16:41] * ntpttr_ (~ntpttr@jfdmzpr06-ext.jf.intel.com) has joined #ceph
[16:45] * doppelgrau (~doppelgra@dslb-088-072-094-200.088.072.pools.vodafone-ip.de) has joined #ceph
[16:45] * srk (~Siva@cpe-70-113-23-93.austin.res.rr.com) has joined #ceph
[16:49] * rdas (~rdas@121.244.87.116) Quit (Quit: Leaving)
[16:52] * ivve (~zed@cust-gw-11.se.zetup.net) Quit (Ping timeout: 480 seconds)
[16:52] * rotbeard (~redbeard@185.32.80.238) Quit (Quit: Leaving)
[16:54] * ntpttr_ (~ntpttr@jfdmzpr06-ext.jf.intel.com) Quit (Ping timeout: 480 seconds)
[16:57] <dbbyleo> lesseb that rbd command works too.
[16:57] * ahmeni (~AGaW@5AEAAAXYH.tor-irc.dnsbl.oftc.net) Quit ()
[16:58] * srk (~Siva@cpe-70-113-23-93.austin.res.rr.com) Quit (Ping timeout: 480 seconds)
[16:58] * joshd1 (~jdurgin@2602:30a:c089:2b0:dc26:c236:3fd:f43a) has joined #ceph
[16:58] <dbbyleo> leseb that rbd command works too. (soory for the repeat)
[16:59] <leseb> dbbyleo np, ok great, well I can give it a try give me a moment
[17:00] * EinstCrazy (~EinstCraz@61.165.253.190) has joined #ceph
[17:02] * wushudoin (~wushudoin@2601:646:8281:cfd:2ab2:bdff:fe0b:a6ee) has joined #ceph
[17:05] * ade (~abradshaw@p4FF79F5F.dip0.t-ipconnect.de) Quit (Quit: Too sexy for his shirt)
[17:07] * sudocat (~dibarra@104-188-116-197.lightspeed.hstntx.sbcglobal.net) Quit (Ping timeout: 480 seconds)
[17:09] * KindOne (sillyfool@0001a7db.user.oftc.net) Quit (Read error: Connection reset by peer)
[17:10] * cathode (~cathode@50.232.215.114) has joined #ceph
[17:10] * kefu (~kefu@114.92.99.82) Quit (Max SendQ exceeded)
[17:11] * kefu (~kefu@114.92.99.82) has joined #ceph
[17:12] * KindOne (sillyfool@h125.161.186.173.dynamic.ip.windstream.net) has joined #ceph
[17:16] * kefu is now known as kefu|afk
[17:16] * bara (~bara@213.175.37.12) Quit (Ping timeout: 480 seconds)
[17:17] * sudocat (~dibarra@192.185.1.20) has joined #ceph
[17:19] * kefu|afk (~kefu@114.92.99.82) Quit (Max SendQ exceeded)
[17:20] * kefu (~kefu@114.92.99.82) has joined #ceph
[17:21] <Vaelatern> What do you folks think: Could I use ceph as a backup solution from one machine to an identical machine several thousand miles away? Specifically, as a replication solution, where if either machine gets a new file, it gets copied to the other?
[17:23] * EinstCrazy (~EinstCraz@61.165.253.190) Quit (Remote host closed the connection)
[17:24] * EinstCrazy (~EinstCraz@61.165.253.190) has joined #ceph
[17:25] * srk (~Siva@cpe-70-113-23-93.austin.res.rr.com) has joined #ceph
[17:26] * bara (~bara@nat-pool-brq-t.redhat.com) has joined #ceph
[17:26] <nils_> I don't think that is a good idea.
[17:27] <Vaelatern> I expect low writes. I expect that each site will only be modifying one part of the file tree.
[17:27] <Vaelatern> And different parts for each site
[17:28] * kefu is now known as kefu|afk
[17:29] * bara (~bara@nat-pool-brq-t.redhat.com) Quit ()
[17:30] * haplo37 (~haplo37@199.91.185.156) has joined #ceph
[17:32] * EinstCrazy (~EinstCraz@61.165.253.190) Quit (Ping timeout: 480 seconds)
[17:40] * branto (~branto@ip-78-102-208-181.net.upcbroadband.cz) Quit (Quit: Leaving.)
[17:43] * analbeard (~shw@support.memset.com) Quit (Quit: Leaving.)
[17:44] * dyasny (~dyasny@cable-192.222.152.136.electronicbox.net) Quit (Ping timeout: 480 seconds)
[17:45] * dyasny (~dyasny@cable-192.222.152.136.electronicbox.net) has joined #ceph
[17:46] * Be-El (~blinke@nat-router.computational.bio.uni-giessen.de) has left #ceph
[17:48] * derjohn_mobi (~aj@2001:6f8:1337:0:845d:8d8b:b673:fcdd) Quit (Ping timeout: 480 seconds)
[17:51] * srk (~Siva@cpe-70-113-23-93.austin.res.rr.com) Quit (Read error: Connection reset by peer)
[17:51] * Shesh (~dotblank@ca.00.39a9.ip4.static.sl-reverse.com) has joined #ceph
[17:52] * srk (~Siva@cpe-70-113-23-93.austin.res.rr.com) has joined #ceph
[17:52] * linuxkidd (~linuxkidd@ip70-189-207-54.lv.lv.cox.net) has joined #ceph
[17:53] * ircolle (~Adium@2601:285:201:633a:f1bf:1a31:bd18:7c47) has joined #ceph
[17:58] * davidzlap (~Adium@rrcs-74-87-213-28.west.biz.rr.com) Quit (Quit: Leaving.)
[18:00] * haplo37 (~haplo37@199.91.185.156) Quit (Remote host closed the connection)
[18:01] * LiftedKilt (LiftedKilt@is.in.the.madhacker.biz) Quit (Quit: Kilted Southern)
[18:05] * LiftedKilt (~LiftedKil@is.in.the.madhacker.biz) has joined #ceph
[18:06] <dbbyleo> Hi all - I installed my first ceph system yesterday. Everything was working fine - block, object and FS. So today I rebooted all the nodes to see what happens. I find that none of OSD services will start - I have 3 OSDs, none will start. The ceph command from the admin node just hangs.
[18:10] * garphy is now known as garphy`aw
[18:11] * vbellur (~vijay@71.234.224.255) Quit (Ping timeout: 480 seconds)
[18:21] * srk (~Siva@cpe-70-113-23-93.austin.res.rr.com) Quit (Read error: Connection reset by peer)
[18:21] * Shesh (~dotblank@26XAAA0R8.tor-irc.dnsbl.oftc.net) Quit ()
[18:22] * srk (~Siva@cpe-70-113-23-93.austin.res.rr.com) has joined #ceph
[18:23] * getup (~getup@095-097-074-074.static.chello.nl) Quit (Quit: My MacBook Pro has gone to sleep. ZZZzzz???)
[18:23] * art_yo (~kvirc@149.126.169.197) Quit (Ping timeout: 480 seconds)
[18:26] * Kyso_ (~elt@94.23.156.213) has joined #ceph
[18:27] * davidzlap (~Adium@cpe-172-91-154-245.socal.res.rr.com) has joined #ceph
[18:28] * mattch (~mattch@w5430.see.ed.ac.uk) Quit (Ping timeout: 480 seconds)
[18:32] * kefu|afk (~kefu@114.92.99.82) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[18:35] <dbbyleo> cephadmin@ceph01:~$ ceph-conf --name mon.0 --show-config-value admin_socket
[18:35] <dbbyleo> ... /var/run/ceph/ceph-mon.0.asok
[18:35] <dbbyleo> but /var/run/ceph/ceph-mon.0.asok
[18:35] <dbbyleo> is missing
[18:35] * EinstCrazy (~EinstCraz@61.165.253.190) has joined #ceph
[18:36] <dbbyleo> I'm trying to troubleshoot my monitors
[18:36] <dbbyleo> and trying to use the admin socket.
[18:36] <dbbyleo> Is this file supposed to be present??
[18:38] <walbuci> ok, I've made some changes to the config, restarted the osds, and all looks normal while scrubbing. :-s
[18:38] <walbuci> Don't know whether config changes or restart changed the behaviour
[18:39] * _mrp (~mrp@82.117.199.26) has joined #ceph
[18:39] <walbuci> Clients are now actually *much* quicker too.
[18:40] <walbuci> Well, stat() times are taking 4-6ms vs. 5-11ms :-P
[18:46] * nils_ (~nils_@doomstreet.collins.kg) Quit (Quit: This computer has gone to sleep)
[18:48] * nils_ (~nils_@doomstreet.collins.kg) has joined #ceph
[18:51] * badone (~badone@66.187.239.16) Quit (Ping timeout: 480 seconds)
[18:56] * Kyso_ (~elt@61TAAA99D.tor-irc.dnsbl.oftc.net) Quit ()
[19:02] * DanFoster (~Daniel@office.34sp.com) Quit (Quit: Leaving)
[19:08] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:f01f:657e:17e3:bfd5) Quit (Ping timeout: 480 seconds)
[19:14] * vasu (~vasu@c-73-231-60-138.hsd1.ca.comcast.net) has joined #ceph
[19:15] * ntpttr_ (~ntpttr@192.55.54.42) has joined #ceph
[19:19] * vbellur (~vijay@nat-pool-bos-t.redhat.com) has joined #ceph
[19:27] * Phase (~verbalins@89-72-54-15.dynamic.chello.pl) has joined #ceph
[19:28] * Phase is now known as Guest5858
[19:29] * joshd1 (~jdurgin@2602:30a:c089:2b0:dc26:c236:3fd:f43a) Quit (Quit: Leaving.)
[19:31] * srk (~Siva@cpe-70-113-23-93.austin.res.rr.com) Quit (Ping timeout: 480 seconds)
[19:33] * srk (~Siva@cpe-70-113-23-93.austin.res.rr.com) has joined #ceph
[19:34] * oliveiradan2 (~doliveira@67.214.238.80) Quit (Read error: No route to host)
[19:39] * Nicho1as (~nicho1as@00022427.user.oftc.net) Quit (Quit: A man from the Far East; using WeeChat 1.5)
[19:39] * Guest5858 (~verbalins@9YSAABA1S.tor-irc.dnsbl.oftc.net) Quit (Read error: Connection reset by peer)
[19:48] * EinstCrazy (~EinstCraz@61.165.253.190) Quit (Remote host closed the connection)
[19:50] * chunmei (~chunmei@134.134.139.77) has joined #ceph
[19:52] * wjw-freebsd (~wjw@smtp.digiware.nl) has joined #ceph
[19:54] * pdrakeweb (~pdrakeweb@cpe-71-74-153-111.neo.res.rr.com) Quit (Quit: Leaving...)
[19:58] * hellertime (~Adium@pool-71-162-119-41.bstnma.fios.verizon.net) Quit (Quit: Leaving.)
[19:59] * pdrakeweb (~pdrakeweb@cpe-71-74-153-111.neo.res.rr.com) has joined #ceph
[20:01] * dgurtner (~dgurtner@84-73-130-19.dclient.hispeed.ch) Quit (Ping timeout: 480 seconds)
[20:02] * evelu (~erwan@poo40-1-78-231-184-196.fbx.proxad.net) Quit (Ping timeout: 480 seconds)
[20:10] * BlaXpirit (~irc@blaxpirit.com) Quit (Quit: Bye)
[20:11] * BlaXpirit (~irc@blaxpirit.com) has joined #ceph
[20:12] * jfaj_ (~jan@p20030084AF0B50005EC5D4FFFEBB68A4.dip0.t-ipconnect.de) Quit (Quit: WeeChat 1.5)
[20:12] * essjayhch (uid79416@id-79416.highgate.irccloud.com) Quit (Quit: Connection closed for inactivity)
[20:13] * jfaj (~jan@p20030084AF0B50005EC5D4FFFEBB68A4.dip0.t-ipconnect.de) has joined #ceph
[20:16] * bniver (~bniver@71-9-144-29.static.oxfr.ma.charter.com) Quit (Remote host closed the connection)
[20:20] * srk (~Siva@cpe-70-113-23-93.austin.res.rr.com) Quit (Ping timeout: 480 seconds)
[20:20] * _mrp (~mrp@82.117.199.26) Quit (Read error: Connection reset by peer)
[20:20] * _mrp (~mrp@82.117.199.26) has joined #ceph
[20:21] * redbeast12 (~Kizzi@3.ip-37-187-247.eu) has joined #ceph
[20:21] * srk (~Siva@cpe-70-113-23-93.austin.res.rr.com) has joined #ceph
[20:24] * _mrp (~mrp@82.117.199.26) Quit (Read error: Connection reset by peer)
[20:24] * bniver (~bniver@71-9-144-29.static.oxfr.ma.charter.com) has joined #ceph
[20:24] * TomasCZ (~TomasCZ@yes.tenlab.net) has joined #ceph
[20:25] * _mrp (~mrp@82.117.199.26) has joined #ceph
[20:25] * The1_ (~the_one@5.186.54.143) Quit (Read error: Connection reset by peer)
[20:28] * T1 (~the_one@5.186.54.143) has joined #ceph
[20:37] * Wahmed (~wahmed@206.174.203.195) Quit (Quit: Nettalk6 - www.ntalk.de)
[20:38] * blynch (~blynch@vm-nat.msi.umn.edu) has joined #ceph
[20:40] * Wahmed (~wahmed@206.174.203.195) has joined #ceph
[20:42] * johnavp1989 (~jpetrini@8.39.115.8) Quit (Ping timeout: 480 seconds)
[20:43] * Wahmed2 (~wahmed@206.174.203.195) has joined #ceph
[20:48] * Wahmed (~wahmed@206.174.203.195) Quit (Ping timeout: 480 seconds)
[20:51] * redbeast12 (~Kizzi@61TAABABR.tor-irc.dnsbl.oftc.net) Quit ()
[20:51] * rendar (~I@host35-177-dynamic.42-79-r.retail.telecomitalia.it) Quit (Ping timeout: 480 seconds)
[20:53] * _mrp (~mrp@82.117.199.26) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[20:56] * johnavp1989 (~jpetrini@8.39.115.8) has joined #ceph
[20:56] <- *johnavp1989* To prove that you are human, please enter the result of 8+3
[21:04] * derjohn_mobi (~aj@x4db11684.dyn.telefonica.de) has joined #ceph
[21:06] * ntpttr_ (~ntpttr@192.55.54.42) Quit (Remote host closed the connection)
[21:07] * Wahmed2 (~wahmed@206.174.203.195) Quit (Quit: Nettalk6 - www.ntalk.de)
[21:07] * cronburg (~cronburg@wr-130-64-194-145.medford.tufts.edu) has joined #ceph
[21:17] * rendar (~I@host35-177-dynamic.42-79-r.retail.telecomitalia.it) has joined #ceph
[21:20] * stiopa (~stiopa@cpc73832-dals21-2-0-cust453.20-2.cable.virginm.net) has joined #ceph
[21:21] * johnavp1989 (~jpetrini@8.39.115.8) Quit (Ping timeout: 480 seconds)
[21:28] * _mrp (~mrp@178-222-111-193.dynamic.isp.telekom.rs) has joined #ceph
[21:32] * srk (~Siva@cpe-70-113-23-93.austin.res.rr.com) Quit (Ping timeout: 480 seconds)
[21:37] * keeperandy (~textual@50.245.231.209) has joined #ceph
[21:44] * johnavp1989 (~jpetrini@8.39.115.8) has joined #ceph
[21:44] <- *johnavp1989* To prove that you are human, please enter the result of 8+3
[21:44] * bniver (~bniver@71-9-144-29.static.oxfr.ma.charter.com) Quit (Remote host closed the connection)
[21:55] * keeperandy (~textual@50.245.231.209) Quit (Quit: Textual IRC Client: www.textualapp.com)
[21:57] * bniver (~bniver@71-9-144-29.static.oxfr.ma.charter.com) has joined #ceph
[22:02] * vbellur (~vijay@nat-pool-bos-t.redhat.com) Quit (Ping timeout: 480 seconds)
[22:05] * cronburg (~cronburg@wr-130-64-194-145.medford.tufts.edu) Quit (Ping timeout: 480 seconds)
[22:15] * TomasCZ (~TomasCZ@yes.tenlab.net) Quit (Ping timeout: 480 seconds)
[22:20] * TomasCZ (~TomasCZ@yes.tenlab.net) has joined #ceph
[22:20] * TomasCZ (~TomasCZ@yes.tenlab.net) Quit (Max SendQ exceeded)
[22:21] * TomasCZ (~TomasCZ@yes.tenlab.net) has joined #ceph
[22:26] * ntpttr_ (~ntpttr@192.55.54.44) has joined #ceph
[22:28] * georgem (~Adium@206.108.127.16) Quit (Ping timeout: 480 seconds)
[22:32] * nils_ (~nils_@doomstreet.collins.kg) Quit (Quit: This computer has gone to sleep)
[22:33] * TomasCZ (~TomasCZ@yes.tenlab.net) Quit (Ping timeout: 480 seconds)
[22:34] * Jeffrey4l_ (~Jeffrey@110.244.109.79) Quit (Read error: Connection reset by peer)
[22:35] * Jeffrey4l_ (~Jeffrey@110.244.109.79) has joined #ceph
[22:35] * srk (~Siva@cpe-70-113-23-93.austin.res.rr.com) has joined #ceph
[22:36] * ntpttr_ (~ntpttr@192.55.54.44) Quit (Remote host closed the connection)
[22:36] <dbbyleo> Hi... I'm rebuilding a ceph system following the ceph-deploy instructions. I'm in the step of preparing the OSD. I run this command:
[22:36] <dbbyleo> ceph-deploy osd prepare ceph02:vdb
[22:37] <dbbyleo> Then on ceph02 I check the status of the services... and I find this:
[22:37] <dbbyleo> ??? ceph-disk@dev-vdb2.service - Ceph disk activation: /dev/vdb2
[22:37] <dbbyleo> Loaded: loaded (/lib/systemd/system/ceph-disk@.service; static)
[22:37] <dbbyleo> Active: failed (Result: start-limit) since Fri 2016-08-12 14:35:06 MDT; 18s ago
[22:37] <dbbyleo> Main PID: 2862
[22:37] <dbbyleo> Is this normal?
[22:39] * haplo37 (~haplo37@199.91.185.156) has joined #ceph
[22:41] <dbbyleo> I run the same prepare command on my other node and that node doesn't show the above issue in the service status
[22:41] <dbbyleo> HELP?
[22:42] * TomasCZ (~TomasCZ@yes.tenlab.net) has joined #ceph
[22:45] <dbbyleo> Interestingly enough, I tried to retsrat that service and it seemed to start fine.
[22:47] * Sliker (~Skyrider@2.tor.exit.babylon.network) has joined #ceph
[22:50] * georgem (~Adium@24.114.67.192) has joined #ceph
[22:55] * bniver (~bniver@71-9-144-29.static.oxfr.ma.charter.com) Quit (Remote host closed the connection)
[22:56] * wes_dillingham (~wes_dilli@140.247.242.44) Quit (Ping timeout: 480 seconds)
[22:56] * srk (~Siva@cpe-70-113-23-93.austin.res.rr.com) Quit (Ping timeout: 480 seconds)
[22:57] * bniver (~bniver@71-9-144-29.static.oxfr.ma.charter.com) has joined #ceph
[23:02] * chunmei (~chunmei@134.134.139.77) Quit (Remote host closed the connection)
[23:03] * chunmei (~chunmei@134.134.139.77) has joined #ceph
[23:05] * srk (~Siva@cpe-70-113-23-93.austin.res.rr.com) has joined #ceph
[23:05] * Mosibi (~Mosibi@dld.unixguru.nl) Quit (Remote host closed the connection)
[23:06] * brad_mssw (~brad@66.129.88.50) Quit (Quit: Leaving)
[23:07] * _mrp (~mrp@178-222-111-193.dynamic.isp.telekom.rs) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[23:08] * salwasser (~Adium@72.246.3.14) Quit (Quit: Leaving.)
[23:08] * raphaelsc (~raphaelsc@2804:7f2:2080:19f4:5e51:4fff:fe86:bbae) has joined #ceph
[23:09] <raphaelsc> Out of curiosity, is rbd-nbd being constantly used by server? I would like to know if it's common to use nbd in ceph
[23:11] <raphaelsc> I basically would like to know if people are using nbd in ceph. I would like to replace impl of nbd server by my own, and use ceph on top.
[23:14] * georgem (~Adium@24.114.67.192) Quit (Quit: Leaving.)
[23:15] * georgem (~Adium@206.108.127.16) has joined #ceph
[23:16] * Sliker (~Skyrider@5AEAAAX6N.tor-irc.dnsbl.oftc.net) Quit ()
[23:27] <doppelgrau> raphaelsc: do you mean qemu-nbd? I use ist sometimes, but qemu as backend fpr xen and qemu for vServers is quite common IMHO
[23:28] * bniver (~bniver@71-9-144-29.static.oxfr.ma.charter.com) Quit (Remote host closed the connection)
[23:29] * chunmei (~chunmei@134.134.139.77) Quit (Remote host closed the connection)
[23:30] * danieagle (~Daniel@200-100-212-200.dial-up.telesp.net.br) Quit (Quit: Obrigado por Tudo! :-) inte+ :-))
[23:35] * georgem (~Adium@206.108.127.16) Quit (Quit: Leaving.)
[23:37] <dbbyleo> Help Please! This is the second time I've rebuilt my CEPH system. I can get it installed and running fine. But as soon as I reboot the nodes, the OSDs wont startup. System log shows this:
[23:37] <dbbyleo> Aug 12 15:35:17 ceph02 ceph-osd[1255]: 2016-08-12 15:35:17.139647 7fc75ebf4800 -1 ** ERROR: unable to open OSD superblock on /var/lib/ceph/osd/ceph-0: (2) No such file or directory
[23:38] <dbbyleo> ... /var/lib/ceph/osd/ceph-0 does exists though
[23:38] * srk (~Siva@cpe-70-113-23-93.austin.res.rr.com) Quit (Read error: Connection reset by peer)
[23:39] * ntpttr_ (~ntpttr@134.134.139.83) has joined #ceph
[23:40] * mattbenjamin (~mbenjamin@12.118.3.106) Quit (Ping timeout: 480 seconds)
[23:40] <raphaelsc> doppelgrau: when you use qemu-nbd, do you have to set up a nbd server using nbd-server?
[23:41] * chunmei (~chunmei@134.134.139.77) has joined #ceph
[23:42] <doppelgrau> raphaelsc: no, qemu-nbd acts as a nbd server
[23:43] <raphaelsc> doppelgrau: so do you run qemu-nbd where the remote disk is located? i will take a look at the docs
[23:44] <doppelgrau> raphaelsc: i use qemu-nbd for some operations, where I do not want to use the kernel rbd-driver
[23:44] * dneary (~dneary@nat-pool-bos-u.redhat.com) Quit (Ping timeout: 480 seconds)
[23:44] <doppelgrau> I run it on every host that is in the ceph-network, whereever I need it (bind to localhost)
[23:45] * TomasCZ (~TomasCZ@yes.tenlab.net) Quit (Quit: Leaving)
[23:45] <raphaelsc> rbd is the component which you need to install on every ceph node, right?
[23:45] * srk (~Siva@cpe-70-113-23-93.austin.res.rr.com) has joined #ceph
[23:45] <raphaelsc> it's the responsible for communicating with the storage device on which it resides
[23:45] <raphaelsc> is that true?
[23:46] <doppelgrau> rbd is one application for raddos
[23:46] <doppelgrau> raphaelsc: http://docs.ceph.com/docs/jewel/architecture/
[23:47] <dbbyleo> Any help please?
[23:48] <doppelgrau> dbbyleo: propably access-right problems, either during startup or during createion (jewel running as ceph not root can cause some fun)
[23:50] <dbbyleo> doppelgrau I did notice that /var/lib/ceph/osd/ceph-0 is owned by root. If its supposed to be owned by ceph, then I don;t know why that happened. I chown it to ceph and tried to restart the OSD, still wouldn't start
[23:50] <dbbyleo> The folder is empty by the way
[23:50] * haplo37 (~haplo37@199.91.185.156) Quit (Remote host closed the connection)
[23:51] <doppelgrau> disk mounted?
[23:51] <doppelgrau> and it shouldn???t be empty
[23:52] <dbbyleo> Ive rebuilt this CEPH system twice (from scratch). The first time resulted in te same thing - installed and running fine. As soon as I reboot the nodes... wham!
[23:52] <doppelgrau> dbbyleo: which os?
[23:52] <dbbyleo> I'm just following the Quick Start install guide using ceph-deploy
[23:52] <dbbyleo> Debian8
[23:52] * ircolle (~Adium@2601:285:201:633a:f1bf:1a31:bd18:7c47) Quit (Quit: Leaving.)
[23:54] <doppelgrau> dbbyleo: http://tracker.ceph.com/issues/16351
[23:54] <doppelgrau> need to pt a udev-rule manually atm
[23:54] <dbbyleo> disk mounted??? well wait... no its not.
[23:55] <dbbyleo> ... /dev/vdb1 is the OSD partiton I prepared and activiated...
[23:55] <dbbyleo> Am I suppose to add the to the fstab??
[23:56] <dbbyleo> udev-rule?
[23:57] * Defaultti1 (~click@torsrva.snydernet.net) has joined #ceph
[23:57] <doppelgrau> udev-rule! (see the bugreport)
[23:57] <dbbyleo> reading it now
[23:57] * madkiss2 (~madkiss@2a02:8109:8680:2000:69de:61b5:bbb:5f61) Quit (Ping timeout: 480 seconds)

These logs were automatically created by CephLogBot on irc.oftc.net using the Java IRC LogBot.