#ceph IRC Log

Index

IRC Log for 2016-07-22

Timestamps are in GMT/BST.

[0:00] * dnunez (~dnunez@nat-pool-bos-t.redhat.com) Quit (Ping timeout: 480 seconds)
[0:02] * scg (~zscg@27.sub-166-161-212.myvzw.com) has joined #ceph
[0:04] * scg (~zscg@27.sub-166-161-212.myvzw.com) Quit ()
[0:06] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:454c:daa6:f349:3b58) Quit (Ping timeout: 480 seconds)
[0:07] * xarses_ (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) has joined #ceph
[0:09] * wes_dillingham (~wes_dilli@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) has joined #ceph
[0:09] * wjw-freebsd (~wjw@smtp.digiware.nl) Quit (Read error: Connection reset by peer)
[0:11] * gregmark (~Adium@68.87.42.115) Quit (Quit: Leaving.)
[0:13] * asdf1 (~jabbe@32.97.110.56) Quit (Ping timeout: 480 seconds)
[0:15] * wjw-freebsd (~wjw@smtp.digiware.nl) has joined #ceph
[0:17] * MrHeavy (~MrHeavy@pool-108-46-175-58.nycmny.fios.verizon.net) has joined #ceph
[0:21] * elfurbe (~Adam@saint.uits.arizona.edu) has joined #ceph
[0:22] * bniver (~bniver@71-9-144-29.static.oxfr.ma.charter.com) Quit (Remote host closed the connection)
[0:28] * cathode (~cathode@50.232.215.114) Quit (Quit: Leaving)
[0:29] * TMM (~hp@178-84-46-106.dynamic.upc.nl) has joined #ceph
[0:36] * AotC (~Tralin|Sl@chulak.enn.lu) has joined #ceph
[0:37] * penguinRaider (~KiKo@23.94.218.244) Quit (Ping timeout: 480 seconds)
[0:42] * johnavp1989 (~jpetrini@8.39.115.8) Quit (Ping timeout: 480 seconds)
[0:48] * squisher (~dasquishe@seeker.mcbf.net) Quit (Ping timeout: 480 seconds)
[0:51] * rendar (~I@host79-131-dynamic.59-82-r.retail.telecomitalia.it) Quit (Quit: std::lower_bound + std::less_equal *works* with a vector without duplicates!)
[0:51] * penguinRaider (~KiKo@23.94.218.244) has joined #ceph
[0:57] * vata1 (~vata@207.96.182.162) Quit (Quit: Leaving.)
[0:58] * MentalRay (~MentalRay@office-mtl1-nat-146-218-70-69.gtcomm.net) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[1:00] * squisher (~dasquishe@seeker.mcbf.net) has joined #ceph
[1:00] * neurodrone_ (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) has joined #ceph
[1:01] * neurodrone_ (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) Quit ()
[1:06] * ronrib (~boswortr@45.32.242.135) has joined #ceph
[1:06] * kuku (~kuku@119.93.91.136) has joined #ceph
[1:06] * AotC (~Tralin|Sl@9YSAAASH9.tor-irc.dnsbl.oftc.net) Quit ()
[1:07] <Anticimex> so my earlier problems with getting the "cluster [WRN] failed to encode map e33776 with expected crc" appears due to running the jewel ceph-osd against infernalis ceph-mon.
[1:08] <Anticimex> apparently jewel RPMs don't execute "systemctl daemon-reload", so when they restart the ceph-osd daemons, SystemD in its infinite wisdom actually launched the earlier infernalis binary of ceph-osd (which was no longer on disk). amazing
[1:09] <Anticimex> had to do: systemctl daemon-reload ; systemctl restart ceph.target (also after fixing the systemd targets correctly, also required manual intervention)
[1:09] * oms101 (~oms101@p20030057EA6C2D00C6D987FFFE4339A1.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[1:09] <Anticimex> and that's all fine once learned
[1:09] <Anticimex> now however, running jewel, my single-client direct-io latencies went up 10x
[1:09] * neurodrone_ (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) has joined #ceph
[1:09] <Anticimex> so iops /= 10
[1:10] <Anticimex> something for tomorrow
[1:16] * stiopa (~stiopa@cpc73832-dals21-2-0-cust453.20-2.cable.virginm.net) Quit (Ping timeout: 480 seconds)
[1:17] * oms101 (~oms101@p20030057EA1CCE00C6D987FFFE4339A1.dip0.t-ipconnect.de) has joined #ceph
[1:18] * johnavp1989 (~jpetrini@pool-100-14-10-2.phlapa.fios.verizon.net) has joined #ceph
[1:18] <- *johnavp1989* To prove that you are human, please enter the result of 8+3
[1:25] * chopmann (~sirmonkey@2a02:8108:46c0:4315:5050:6d78:2a7b:f685) has joined #ceph
[1:32] <Anticimex> sent an email to ceph-users meanwhile. now Zzz
[1:37] * elfurbe (~Adam@saint.uits.arizona.edu) Quit (Quit: Textual IRC Client: www.textualapp.com)
[1:48] * sudocat (~dibarra@192.185.1.20) Quit (Ping timeout: 480 seconds)
[2:03] * chopmann (~sirmonkey@2a02:8108:46c0:4315:5050:6d78:2a7b:f685) Quit (Quit: chopmann)
[2:06] * oms101 (~oms101@p20030057EA1CCE00C6D987FFFE4339A1.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[2:06] * Random (~Keiya@93.115.95.207) has joined #ceph
[2:11] * noahw (~noahw@eduroam-169-233-225-12.ucsc.edu) Quit (Quit: Leaving)
[2:15] * oms101 (~oms101@p20030057EA060600C6D987FFFE4339A1.dip0.t-ipconnect.de) has joined #ceph
[2:18] * sudocat (~dibarra@104-188-116-197.lightspeed.hstntx.sbcglobal.net) has joined #ceph
[2:23] * i_m (~ivan.miro@nat-5-carp.hcn-strela.ru) has joined #ceph
[2:26] * sudocat (~dibarra@104-188-116-197.lightspeed.hstntx.sbcglobal.net) Quit (Ping timeout: 480 seconds)
[2:26] * elfurbe (~Adam@saint.uits.arizona.edu) has joined #ceph
[2:29] * wushudoin (~wushudoin@38.99.12.237) Quit (Ping timeout: 480 seconds)
[2:29] <elfurbe> So I had to reboot one of my ceph nodes, it was running a mon and six osds. For some reason I can't get any of them to rejoin the cluster now that the host is back up. The host can ping the IPs of the other hosts, I can telnet to/from other hosts and this host on the mon port
[2:29] <elfurbe> Super lost on this one
[2:32] * jdillaman (~jdillaman@pool-108-18-97-95.washdc.fios.verizon.net) has joined #ceph
[2:34] * theTrav (~theTrav@CPE-124-188-218-238.sfcz1.cht.bigpond.net.au) Quit (Remote host closed the connection)
[2:36] * Random (~Keiya@5AEAAAHJY.tor-irc.dnsbl.oftc.net) Quit ()
[2:36] * tuhnis (~mr_flea@marylou.nos-oignons.net) has joined #ceph
[2:37] * sudocat (~dibarra@192.185.1.20) has joined #ceph
[2:37] * jdillaman (~jdillaman@pool-108-18-97-95.washdc.fios.verizon.net) Quit (Quit: jdillaman)
[2:47] * theTrav (~theTrav@1.152.97.71) has joined #ceph
[2:53] * debian112 (~bcolbert@64.235.157.198) Quit (Quit: Leaving.)
[2:54] * ira (~ira@c-24-34-255-34.hsd1.ma.comcast.net) has joined #ceph
[3:00] * Vacuum__ (~Vacuum@i59F79346.versanet.de) has joined #ceph
[3:06] * tuhnis (~mr_flea@9YSAAASK9.tor-irc.dnsbl.oftc.net) Quit ()
[3:06] * Coestar (~PcJamesy@tor-exit-01.1d4.us) has joined #ceph
[3:06] * Vacuum_ (~Vacuum@88.130.221.118) Quit (Ping timeout: 480 seconds)
[3:06] * jermudgeon (~jhaustin@gw1.ttp.biz.whitestone.link) has joined #ceph
[3:07] * EthanL (~lamberet@cce02cs4040-fa12-z.ams.hpecore.net) has joined #ceph
[3:09] * kefu (~kefu@183.193.182.196) has joined #ceph
[3:10] * fsimonce (~simon@host99-64-dynamic.27-79-r.retail.telecomitalia.it) Quit (Remote host closed the connection)
[3:11] * Vacuum_ (~Vacuum@i59F79550.versanet.de) has joined #ceph
[3:11] * theTrav (~theTrav@1.152.97.71) Quit (Remote host closed the connection)
[3:16] * EthanL (~lamberet@cce02cs4040-fa12-z.ams.hpecore.net) Quit (Ping timeout: 480 seconds)
[3:16] * Vacuum__ (~Vacuum@i59F79346.versanet.de) Quit (Ping timeout: 480 seconds)
[3:17] * kefu_ (~kefu@li764-181.members.linode.com) has joined #ceph
[3:18] * kefu (~kefu@183.193.182.196) Quit (Ping timeout: 480 seconds)
[3:19] * vbellur (~vijay@71.234.224.255) has joined #ceph
[3:28] * theTrav (~theTrav@203.35.9.142) has joined #ceph
[3:28] * yanzheng (~zhyan@118.116.114.34) has joined #ceph
[3:31] * vata (~vata@cable-173.246.3-246.ebox.ca) Quit (Quit: Leaving.)
[3:33] * jermudgeon (~jhaustin@gw1.ttp.biz.whitestone.link) Quit (Ping timeout: 480 seconds)
[3:36] * Coestar (~PcJamesy@61TAAARZU.tor-irc.dnsbl.oftc.net) Quit ()
[3:37] * cooey (~Defaultti@ded31663.iceservers.net) has joined #ceph
[3:37] * Racpatel (~Racpatel@2601:87:0:24af::1fbc) Quit (Quit: Leaving)
[3:37] * vata (~vata@cable-173.246.3-246.ebox.ca) has joined #ceph
[3:38] * derjohn_mobi (~aj@x4db124ad.dyn.telefonica.de) has joined #ceph
[3:41] * sebastian-w_ (~quassel@212.218.8.138) has joined #ceph
[3:42] * sebastian-w (~quassel@212.218.8.138) Quit (Read error: Connection reset by peer)
[3:45] * derjohn_mob (~aj@x4db27b7f.dyn.telefonica.de) Quit (Ping timeout: 480 seconds)
[3:51] * davidzlap (~Adium@cpe-172-91-154-245.socal.res.rr.com) Quit (Quit: Leaving.)
[3:55] * Italux (~Italux@186.202.97.3) Quit (Quit: Fui-me-ei)
[3:56] * Jeffrey4l_ (~Jeffrey@120.10.244.6) has joined #ceph
[3:57] * kuku (~kuku@119.93.91.136) Quit (Remote host closed the connection)
[3:57] * kuku (~kuku@119.93.91.136) has joined #ceph
[3:59] * kuku (~kuku@119.93.91.136) Quit (Remote host closed the connection)
[4:05] * vasu (~vasu@c-73-231-60-138.hsd1.ca.comcast.net) Quit (Quit: Leaving)
[4:06] * cooey (~Defaultti@5AEAAAHLW.tor-irc.dnsbl.oftc.net) Quit ()
[4:06] * curtis864 (~skney@61TAAAR00.tor-irc.dnsbl.oftc.net) has joined #ceph
[4:11] * ira (~ira@c-24-34-255-34.hsd1.ma.comcast.net) Quit (Quit: Leaving)
[4:12] * zack_dolby (~textual@p845d32.tokynt01.ap.so-net.ne.jp) has joined #ceph
[4:12] * zack_dolby (~textual@p845d32.tokynt01.ap.so-net.ne.jp) Quit ()
[4:12] * kefu_ (~kefu@li764-181.members.linode.com) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[4:19] * Walex (~Walex@SMTP.sabi.co.UK) Quit (Remote host closed the connection)
[4:21] * yanzheng (~zhyan@118.116.114.34) Quit (Ping timeout: 480 seconds)
[4:23] * yanzheng (~zhyan@118.116.114.34) has joined #ceph
[4:24] * vicente (~~vicente@125-227-238-55.HINET-IP.hinet.net) has joined #ceph
[4:36] * curtis864 (~skney@61TAAAR00.tor-irc.dnsbl.oftc.net) Quit ()
[4:41] * wjw-freebsd (~wjw@smtp.digiware.nl) Quit (Ping timeout: 480 seconds)
[5:02] * elfurbe (~Adam@saint.uits.arizona.edu) Quit (Quit: Textual IRC Client: www.textualapp.com)
[5:02] * kefu (~kefu@183.193.182.196) has joined #ceph
[5:03] * vata (~vata@cable-173.246.3-246.ebox.ca) Quit (Ping timeout: 480 seconds)
[5:05] * EthanL (~lamberet@cce02cs4040-fa12-z.ams.hpecore.net) has joined #ceph
[5:06] * x3031 (~Lattyware@89.43.62.11) has joined #ceph
[5:11] * kefu_ (~kefu@114.92.96.253) has joined #ceph
[5:11] * kuku (~kuku@119.93.91.136) has joined #ceph
[5:13] * vata (~vata@cable-173.246.3-246.ebox.ca) has joined #ceph
[5:15] * kefu (~kefu@183.193.182.196) Quit (Ping timeout: 480 seconds)
[5:15] * EthanL (~lamberet@cce02cs4040-fa12-z.ams.hpecore.net) Quit (Ping timeout: 480 seconds)
[5:31] * MentalRay (~MentalRay@107.171.161.165) has joined #ceph
[5:32] * debian112 (~bcolbert@173-164-167-201-SFBA.hfc.comcastbusiness.net) has joined #ceph
[5:36] * x3031 (~Lattyware@26XAAAIKF.tor-irc.dnsbl.oftc.net) Quit ()
[5:37] * offender (~VampiricP@tor-exit7-readme.dfri.se) has joined #ceph
[5:45] * Vacuum__ (~Vacuum@i59F7969C.versanet.de) has joined #ceph
[5:47] * vimal (~vikumar@114.143.165.70) has joined #ceph
[5:49] * salwasser (~Adium@72.246.3.14) Quit (Quit: Leaving.)
[5:52] * Vacuum_ (~Vacuum@i59F79550.versanet.de) Quit (Ping timeout: 480 seconds)
[5:53] * jermudgeon (~jhaustin@southend.mdu.whitestone.link) has joined #ceph
[5:54] * neurodrone_ (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) Quit (Quit: neurodrone_)
[5:58] * neurodrone_ (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) has joined #ceph
[6:04] * neurodrone_ (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) Quit (Quit: neurodrone_)
[6:04] * JPGainsborough (~jpg@71.122.174.182) has joined #ceph
[6:06] * offender (~VampiricP@9YSAAASO5.tor-irc.dnsbl.oftc.net) Quit ()
[6:11] * carter (~carter@li98-136.members.linode.com) Quit (Ping timeout: 480 seconds)
[6:16] * wes_dillingham (~wes_dilli@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) Quit (Quit: wes_dillingham)
[6:20] * danieagle (~Daniel@179.98.86.132) Quit (Quit: Obrigado por Tudo! :-) inte+ :-))
[6:21] * kefu_ (~kefu@114.92.96.253) Quit (Max SendQ exceeded)
[6:21] * kefu (~kefu@45.32.49.168) has joined #ceph
[6:22] * joshd1 (~jdurgin@2602:30a:c089:2b0:886b:8cf4:786c:c202) Quit (Quit: Leaving.)
[6:31] * vimal (~vikumar@114.143.165.70) Quit (Quit: Leaving)
[6:37] * dougf (~dougf@96-38-99-179.dhcp.jcsn.tn.charter.com) Quit (Ping timeout: 480 seconds)
[6:39] * carter (~carter@li98-136.members.linode.com) has joined #ceph
[6:41] * redbeast12 (~BlS@93.174.90.30) has joined #ceph
[6:46] * MentalRay (~MentalRay@107.171.161.165) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[6:53] * wjw-freebsd (~wjw@smtp.digiware.nl) has joined #ceph
[6:53] * theTrav (~theTrav@203.35.9.142) Quit (Remote host closed the connection)
[6:53] * vimal (~vikumar@121.244.87.116) has joined #ceph
[6:54] * rdas (~rdas@121.244.87.116) has joined #ceph
[6:56] * vikumar (~vikumar@121.244.87.116) has joined #ceph
[6:56] * vikumar (~vikumar@121.244.87.116) Quit (Remote host closed the connection)
[6:59] * swami1 (~swami@49.38.1.109) has joined #ceph
[7:10] * EthanL (~lamberet@cce02cs4040-fa12-z.ams.hpecore.net) has joined #ceph
[7:11] * redbeast12 (~BlS@61TAAAR4W.tor-irc.dnsbl.oftc.net) Quit ()
[7:11] * raindog (~xolotl@89.163.135.98) has joined #ceph
[7:19] * EthanL (~lamberet@cce02cs4040-fa12-z.ams.hpecore.net) Quit (Ping timeout: 480 seconds)
[7:20] * vikhyat (~vumrao@121.244.87.116) has joined #ceph
[7:20] * babilen (~babilen@babilen.user.oftc.net) Quit (Read error: Connection reset by peer)
[7:20] * babilen (~babilen@babilen.user.oftc.net) has joined #ceph
[7:22] * dougf (~dougf@96-38-99-179.dhcp.jcsn.tn.charter.com) has joined #ceph
[7:41] * raindog (~xolotl@61TAAAR8I.tor-irc.dnsbl.oftc.net) Quit ()
[7:41] * tokie (~RaidSoft@93.115.95.201) has joined #ceph
[7:46] * stiopa (~stiopa@cpc73832-dals21-2-0-cust453.20-2.cable.virginm.net) has joined #ceph
[7:55] * stiopa (~stiopa@cpc73832-dals21-2-0-cust453.20-2.cable.virginm.net) Quit (Ping timeout: 480 seconds)
[7:56] * theTrav (~theTrav@CPE-124-188-218-238.sfcz1.cht.bigpond.net.au) has joined #ceph
[8:07] * wjw-freebsd (~wjw@smtp.digiware.nl) Quit (Ping timeout: 480 seconds)
[8:11] * tokie (~RaidSoft@61TAAASCQ.tor-irc.dnsbl.oftc.net) Quit ()
[8:11] * Arfed (~Knuckx@178-17-170-253.static.host) has joined #ceph
[8:11] * nils_ (~nils_@doomstreet.collins.kg) has joined #ceph
[8:12] * verleihnix (~verleihni@195-202-198-60.dynamic.hispeed.ch) Quit (Ping timeout: 480 seconds)
[8:13] * verleihnix (~verleihni@195.12.46.2) has joined #ceph
[8:18] * kawa2014 (~kawa@89.184.114.246) has joined #ceph
[8:22] * kefu (~kefu@45.32.49.168) Quit (Max SendQ exceeded)
[8:22] * kefu (~kefu@45.32.49.168) has joined #ceph
[8:27] * post-factum (~post-fact@vulcan.natalenko.name) Quit (Killed (NickServ (Too many failed password attempts.)))
[8:27] * post-factum (~post-fact@vulcan.natalenko.name) has joined #ceph
[8:29] * karnan (~karnan@121.244.87.117) has joined #ceph
[8:32] * sudocat (~dibarra@192.185.1.20) Quit (Ping timeout: 480 seconds)
[8:38] * owasserm (~owasserm@2001:984:d3f7:1:5ec5:d4ff:fee0:f6dc) Quit (Ping timeout: 480 seconds)
[8:41] * Arfed (~Knuckx@5AEAAAHXT.tor-irc.dnsbl.oftc.net) Quit ()
[8:41] * Throlkim (~matx@93.115.95.216) has joined #ceph
[8:50] * swami1 (~swami@49.38.1.109) Quit (Quit: Leaving.)
[8:57] * kefu (~kefu@45.32.49.168) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[9:01] * ade (~abradshaw@81.145.205.233) has joined #ceph
[9:01] * ade (~abradshaw@81.145.205.233) Quit ()
[9:02] * chopmann (~sirmonkey@x4dbb6f0d.dyn.telefonica.de) has joined #ceph
[9:02] * ade (~abradshaw@81.145.205.233) has joined #ceph
[9:06] * kefu (~kefu@183.193.182.196) has joined #ceph
[9:08] * penguinRaider (~KiKo@23.94.218.244) Quit (Ping timeout: 480 seconds)
[9:11] * Throlkim (~matx@9YSAAASX0.tor-irc.dnsbl.oftc.net) Quit ()
[9:14] * rraja (~rraja@121.244.87.117) has joined #ceph
[9:17] * penguinRaider (~KiKo@23.94.218.244) has joined #ceph
[9:18] * fsimonce (~simon@host99-64-dynamic.27-79-r.retail.telecomitalia.it) has joined #ceph
[9:18] * georgem (~Adium@85.204.4.209) has joined #ceph
[9:18] * georgem (~Adium@85.204.4.209) Quit ()
[9:19] * georgem (~Adium@206.108.127.16) has joined #ceph
[9:21] * Hemanth (~hkumar_@103.228.221.160) has joined #ceph
[9:22] * vata (~vata@cable-173.246.3-246.ebox.ca) Quit (Ping timeout: 480 seconds)
[9:22] * b0e (~aledermue@213.95.25.82) has joined #ceph
[9:23] * swami1 (~swami@49.38.1.109) has joined #ceph
[9:25] * chopmann (~sirmonkey@x4dbb6f0d.dyn.telefonica.de) Quit (Quit: chopmann)
[9:26] * chopmann (~sirmonkey@x4dbb6f0d.dyn.telefonica.de) has joined #ceph
[9:26] * georgem (~Adium@206.108.127.16) Quit (Quit: Leaving.)
[9:31] * chopmann (~sirmonkey@x4dbb6f0d.dyn.telefonica.de) Quit (Quit: chopmann)
[9:31] * kefu_ (~kefu@114.92.96.253) has joined #ceph
[9:32] * kefu (~kefu@183.193.182.196) Quit (Ping timeout: 480 seconds)
[9:40] * allaok (~allaok@machine107.orange-labs.com) has joined #ceph
[9:40] * analbeard (~shw@host109-149-32-128.range109-149.btcentralplus.com) has joined #ceph
[9:43] * TMM (~hp@178-84-46-106.dynamic.upc.nl) Quit (Quit: Ex-Chat)
[9:48] * kefu_ (~kefu@114.92.96.253) Quit (Max SendQ exceeded)
[9:49] * kefu (~kefu@45.32.49.168) has joined #ceph
[9:50] * vata (~vata@cable-173.246.3-246.ebox.ca) has joined #ceph
[9:51] * jermudgeon (~jhaustin@southend.mdu.whitestone.link) Quit (Quit: jermudgeon)
[9:51] * owasserm (~owasserm@2001:984:d3f7:1:5ec5:d4ff:fee0:f6dc) has joined #ceph
[9:58] <sep> when starting a osd, sometimes the log gets stuck for quite a while (minues) on "journal _open /var/lib/ceph/osd/ceph-34/journal" ; other times it quickly progresses to load_pgs ;; journal is a file on the spinner. anyone know why it ocasionally takes so long ?
[9:59] * derjohn_mobi (~aj@x4db124ad.dyn.telefonica.de) Quit (Ping timeout: 480 seconds)
[10:00] * kuku (~kuku@119.93.91.136) Quit (Remote host closed the connection)
[10:04] * analbeard (~shw@host109-149-32-128.range109-149.btcentralplus.com) Quit (Ping timeout: 480 seconds)
[10:05] * hybrid512 (~walid@195.200.189.206) has joined #ceph
[10:05] * analbeard (~shw@support.memset.com) has joined #ceph
[10:07] * yanzheng1 (~zhyan@118.116.114.34) has joined #ceph
[10:07] * bara (~bara@nat-pool-brq-t.redhat.com) has joined #ceph
[10:07] * garphy`aw is now known as garphy
[10:08] * yanzheng (~zhyan@118.116.114.34) Quit (Ping timeout: 480 seconds)
[10:14] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:454c:daa6:f349:3b58) has joined #ceph
[10:16] * rendar (~I@host230-180-dynamic.12-79-r.retail.telecomitalia.it) has joined #ceph
[10:19] * jowilkin (~jowilkin@2601:644:4000:b0bf:56ee:75ff:fe10:724e) Quit (Ping timeout: 480 seconds)
[10:19] * rotbeard (~redbeard@185.32.80.238) has joined #ceph
[10:19] * cyphase (~cyphase@000134f2.user.oftc.net) Quit (Ping timeout: 480 seconds)
[10:20] * richardus1 (~matx@109.236.90.209) has joined #ceph
[10:24] * branto (~branto@ip-78-102-208-181.net.upcbroadband.cz) has joined #ceph
[10:26] * ade (~abradshaw@81.145.205.233) Quit (Quit: Too sexy for his shirt)
[10:27] * analbeard (~shw@support.memset.com) Quit (Quit: Leaving.)
[10:28] * jowilkin (~jowilkin@2601:644:4000:b0bf:56ee:75ff:fe10:724e) has joined #ceph
[10:28] * cyphase (~cyphase@000134f2.user.oftc.net) has joined #ceph
[10:31] * kefu_ (~kefu@114.92.96.253) has joined #ceph
[10:33] * kefu (~kefu@45.32.49.168) Quit (Read error: Connection reset by peer)
[10:35] * kefu_ (~kefu@114.92.96.253) Quit (Max SendQ exceeded)
[10:37] * derjohn_mobi (~aj@2001:6f8:1337:0:3d:bd1a:127c:397d) has joined #ceph
[10:37] * kefu (~kefu@114.92.96.253) has joined #ceph
[10:38] * TMM (~hp@185.5.121.201) has joined #ceph
[10:46] * kefu (~kefu@114.92.96.253) Quit (Max SendQ exceeded)
[10:50] * richardus1 (~matx@9YSAAASZP.tor-irc.dnsbl.oftc.net) Quit ()
[10:51] * kefu (~kefu@114.92.96.253) has joined #ceph
[10:51] * briner (~briner@129.194.16.54) Quit (Remote host closed the connection)
[10:52] * briner (~briner@2001:620:600:1000:5d26:8eaa:97f0:8115) has joined #ceph
[11:02] * penguinRaider (~KiKo@23.94.218.244) Quit (Ping timeout: 480 seconds)
[11:05] * dgurtner (~dgurtner@84-73-130-19.dclient.hispeed.ch) has joined #ceph
[11:15] * penguinRaider (~KiKo@14.139.82.6) has joined #ceph
[11:20] * kefu (~kefu@114.92.96.253) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[11:28] * penguinRaider (~KiKo@14.139.82.6) Quit (Ping timeout: 480 seconds)
[11:36] * penguinRaider (~KiKo@103.6.219.219) has joined #ceph
[11:38] * theTrav (~theTrav@CPE-124-188-218-238.sfcz1.cht.bigpond.net.au) Quit (Remote host closed the connection)
[11:43] * danieagle (~Daniel@177.188.67.145) has joined #ceph
[11:48] * Hemanth (~hkumar_@103.228.221.160) Quit (Quit: Leaving)
[11:49] * InIMoeK (~InIMoeK@95.170.93.16) has joined #ceph
[11:55] * Xerati (~Bonzaii@176.10.99.206) has joined #ceph
[12:03] * rraja (~rraja@121.244.87.117) Quit (Quit: Leaving)
[12:06] * penguinRaider (~KiKo@103.6.219.219) Quit (Ping timeout: 480 seconds)
[12:13] * wgao (~wgao@106.120.101.38) Quit (Ping timeout: 480 seconds)
[12:13] <sep> some osd's print " 7f48891b7700 1 heartbeat_map is_healthy 'OSD::osd_op_tp thread 0x7f48831ab700' had timed out after 15" with increasing numbers a few thousand lines a second. what does this log line mean ? also is not a few thousand lines a second slightly overkill ?
[12:22] * dgurtner (~dgurtner@84-73-130-19.dclient.hispeed.ch) Quit (Ping timeout: 480 seconds)
[12:24] * Xerati (~Bonzaii@26XAAAIX2.tor-irc.dnsbl.oftc.net) Quit ()
[12:25] * penguinRaider (~KiKo@103.6.219.219) has joined #ceph
[12:26] * wgao (~wgao@106.120.101.38) has joined #ceph
[12:27] * Vacuum_ (~Vacuum@88.130.212.55) has joined #ceph
[12:29] * Kurimus1 (~Dysgalt@freeciv.nmte.ch) has joined #ceph
[12:33] * Vacuum__ (~Vacuum@i59F7969C.versanet.de) Quit (Ping timeout: 480 seconds)
[12:34] * wgao (~wgao@106.120.101.38) Quit (Ping timeout: 480 seconds)
[12:40] <sep> i also am still looking for my previous questions, for anyone recently awake : when starting a osd, sometimes the log gets stuck for quite a while (sometimes 10's of minues) on "journal _open /var/lib/ceph/osd/ceph-34/journal" ; other times it quickly progresses to load_pgs ;; journal is a file on the spinner. anyone know why it occasionally takes so long ?
[12:40] * georgem (~Adium@85.204.4.209) has joined #ceph
[12:49] * georgem (~Adium@85.204.4.209) Quit (Quit: Leaving.)
[12:49] * kawa2014 (~kawa@89.184.114.246) Quit (Quit: Leaving)
[12:57] * penguinRaider (~KiKo@103.6.219.219) Quit (Ping timeout: 480 seconds)
[12:59] * Kurimus1 (~Dysgalt@5AEAAAH18.tor-irc.dnsbl.oftc.net) Quit ()
[13:00] * gregmark (~Adium@68.87.42.115) has joined #ceph
[13:06] * penguinRaider (~KiKo@103.6.219.219) has joined #ceph
[13:07] * garphy is now known as garphy`aw
[13:08] * Miouge (~Miouge@109.128.94.173) has joined #ceph
[13:10] * vicente (~~vicente@125-227-238-55.HINET-IP.hinet.net) Quit (Quit: Leaving)
[13:14] * bene2 (~bene@2601:193:4101:f410:ea2a:eaff:fe08:3c7a) has joined #ceph
[13:14] <sep> taken about 1 houers now on one of my osd's stuck at journal _open /var/lib/ceph/osd/ceph-34/journal ; iostat shows the device irregularrly reading and writing some 2-300 kB/sec
[13:15] * swami1 (~swami@49.38.1.109) Quit (Quit: Leaving.)
[13:15] * Miouge (~Miouge@109.128.94.173) Quit (Quit: Miouge)
[13:16] <InIMoeK> sep no IO wait?
[13:17] <sep> just a llittle, not more then normal for this node %Cpu(s): 3.4 us, 1.6 sy, 0.0 ni, 90.7 id, 3.6 wa, 0.0 hi, 0.7 si, 0.0 st
[13:17] * penguinRaider (~KiKo@103.6.219.219) Quit (Ping timeout: 480 seconds)
[13:18] <sep> hum that was not so acurate. some cores have nothing. but a few cores have 20-30 ish
[13:20] * rdas (~rdas@121.244.87.116) Quit (Quit: Leaving)
[13:22] <sep> 3305 root 20 0 0 0 0 S 0.3 0.0 0:00.91 xfsaild/md124p1
[13:22] <sep> 3315 root 20 0 0 0 0 D 0.3 0.0 0:05.27 xfsaild/md122p1
[13:23] <sep> md122 is the slow osd. it's the onlt one of the xfsaild processes in the D state
[13:23] <sep> googeling xfsaild :)
[13:26] * penguinRaider (~KiKo@146.185.31.226) has joined #ceph
[13:30] <sep> same on one of the other nodes that also have a osd with the same problem. a few have finished after an houer and continued osd boot and are in/up now so they do eventually get there
[13:32] <InIMoeK> do you have that much spinners that your journals are on the hdd?
[13:32] * Miouge (~Miouge@109.128.94.173) has joined #ceph
[13:33] <InIMoeK> just out of curiousity
[13:35] * efirs1 (~firs@31.173.242.249) has joined #ceph
[13:42] <sep> more that i do not have gotten approval for $??for ssd journals yet
[13:42] <sep> but yes there are 5 disks in software raid5 with osd and journal partition on
[13:43] <InIMoeK> but you know raid5 is kind of slow in the first place
[13:43] <sep> and the reason for the raid5 is that i have a problem with too little ram. and by bundeling 5 disks into a raid i hope to save some.
[13:43] <InIMoeK> en ceph ontop of partity isnt very efficient either
[13:43] <sep> 30 osds becomes 6..
[13:43] <InIMoeK> just my thougts
[13:44] <sep> InIMoeK, indeed i know. i am tring to space and stabillity, and sacrificing performance
[13:45] <sep> but other raid devices does not take this long to start. so there is oviously something going on. but it's not obvious what
[13:52] <InIMoeK> mdadm not compaining?
[13:54] <sep> nothing
[13:54] <sep> no rescan or check or anything.
[13:54] <sep> there all was started...
[13:54] <sep> about 2,5 houers
[13:54] <sep> on those 2 osd's
[13:54] <sep> the other 20 started with no such issue
[13:55] * bniver (~bniver@71-9-144-29.static.oxfr.ma.charter.com) has joined #ceph
[13:58] * Racpatel (~Racpatel@2601:87:0:24af::f12b) has joined #ceph
[13:58] * gregmark (~Adium@68.87.42.115) Quit (Quit: Leaving.)
[13:59] * onyb (~ani07nov@119.82.105.66) has joined #ceph
[14:02] * swami1 (~swami@27.7.165.198) has joined #ceph
[14:07] * allaok (~allaok@machine107.orange-labs.com) has left #ceph
[14:08] * irq0 (~seri@amy.irq0.org) Quit (Ping timeout: 480 seconds)
[14:13] * garphy`aw is now known as garphy
[14:22] * thomnico (~thomnico@2a01:e35:8b41:120:2411:966a:8740:f9a3) has joined #ceph
[14:23] * johnavp1989 (~jpetrini@pool-100-14-10-2.phlapa.fios.verizon.net) Quit (Ping timeout: 480 seconds)
[14:24] <Miouge> InIMoeK: there has been some discussions on the ML about RAID6 on top of ceph for high density nodes (60+ OSD/node).
[14:28] * rakeshgm (~rakesh@106.51.225.17) has joined #ceph
[14:28] * bvi (~Bastiaan@185.56.32.1) has joined #ceph
[14:29] * danielsj (~DJComet@tor-exit4-readme.dfri.se) has joined #ceph
[14:31] * neurodrone_ (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) has joined #ceph
[14:31] * irq0 (~seri@amy.irq0.org) has joined #ceph
[14:41] * yanzheng1 (~zhyan@118.116.114.34) Quit (Quit: This computer has gone to sleep)
[14:41] <MrBy> Hi, I have a test2 radosgw user. I deleted all the buckets in there, but radosgw-admin --uid="test2" -n client.rgw.vs100 user stats --sync-stats still shows "total_bytes": 31457280. Anybody any glue why it does not show 0 ?
[14:41] * vimal (~vikumar@121.244.87.116) Quit (Quit: Leaving)
[14:42] <sep> Miouge, raid on top of ceph ? or did you mean ceph on top of raid as i do ?
[14:43] <Miouge> Yes, ceph on top of raid :)
[14:44] <sep> i run it on jessie + hammer 0.94.7 ; but for some reason i have to mount and start osd's manually when i reboot. i am very certain that i did not have to do that on 0.94.5
[14:45] * wgao (~wgao@106.120.101.38) has joined #ceph
[14:46] <Miouge> I was hinting at this thread: http://lists.ceph.com/pipermail/ceph-users-ceph.com/2016-May/009940.html
[14:53] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:454c:daa6:f349:3b58) Quit (Ping timeout: 480 seconds)
[14:55] * rwheeler (~rwheeler@nat-pool-bos-t.redhat.com) has joined #ceph
[14:59] * danielsj (~DJComet@9YSAAAS4D.tor-irc.dnsbl.oftc.net) Quit ()
[14:59] * thomnico (~thomnico@2a01:e35:8b41:120:2411:966a:8740:f9a3) Quit (Quit: Ex-Chat)
[15:03] <sep> i suspect that the 2 arid sets are performing extraordinarry badly compared to the rest. 90% of all slow requests are on those 2 md devices.
[15:03] <sep> mdadm does not complain tho.
[15:10] <InIMoeK> sep maybe a bad drive?
[15:10] <InIMoeK> have you checked smart status
[15:10] * swami1 (~swami@27.7.165.198) Quit (Quit: Leaving.)
[15:10] <InIMoeK> any metrics thats are higer than the rest
[15:12] * penguinRaider (~KiKo@146.185.31.226) Quit (Ping timeout: 480 seconds)
[15:12] * brad_mssw (~brad@66.129.88.50) has joined #ceph
[15:13] * johnavp1989 (~jpetrini@8.39.115.8) has joined #ceph
[15:13] <- *johnavp1989* To prove that you are human, please enter the result of 8+3
[15:16] * r0lland (~r0lland@121.244.155.12) Quit (Ping timeout: 480 seconds)
[15:16] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:454c:daa6:f349:3b58) has joined #ceph
[15:20] <sep> ... they are all bad drives... they need punishement !
[15:21] <TheSov> has anyone tried putting osd's on zfs on ubuntu 16.04?
[15:21] <TheSov> doesnt seem to work ok
[15:22] * mattbenjamin (~mbenjamin@12.118.3.106) has joined #ceph
[15:23] * bvi (~Bastiaan@185.56.32.1) Quit (Quit: Leaving)
[15:23] * efirs1 (~firs@31.173.242.249) Quit (Ping timeout: 480 seconds)
[15:24] * penguinRaider (~KiKo@146.185.31.226) has joined #ceph
[15:26] * jdillaman (~jdillaman@pool-108-18-97-95.washdc.fios.verizon.net) has joined #ceph
[15:27] * nils_ (~nils_@doomstreet.collins.kg) Quit (Quit: This computer has gone to sleep)
[15:29] <sep> kind of looks like the drives on that partiqular md device are the only drives in the system that does not have some kind of early warning in smart ... perhaps they feel left out.
[15:31] * squizzi (~squizzi@107.13.31.195) has joined #ceph
[15:38] * wes_dillingham (~wes_dilli@65.112.8.203) has joined #ceph
[15:39] * theTrav (~theTrav@CPE-124-188-218-238.sfcz1.cht.bigpond.net.au) has joined #ceph
[15:40] * derjohn_mobi (~aj@2001:6f8:1337:0:3d:bd1a:127c:397d) Quit (Ping timeout: 480 seconds)
[15:40] * salwasser (~Adium@72.246.3.14) has joined #ceph
[15:41] * shaunm (~shaunm@74.83.215.100) has joined #ceph
[15:42] <InIMoeK> TheSov no only xfs on 16.04
[15:42] * F|1nt (~F|1nt@host37-212.lan-isdn.imaginet.fr) has joined #ceph
[15:42] * cronburg (~cronburg@209-6-91-147.c3-0.smr-ubr1.sbo-smr.ma.cable.rcn.com) has joined #ceph
[15:43] <TheSov> InIMoeK, you know zfs in native on 16.04 right?
[15:43] * zhen (~Thunderbi@117.114.147.135) has joined #ceph
[15:44] <InIMoeK> yes
[15:44] <InIMoeK> but zfs has allot of extra stuff I dont want to be thinking of
[15:45] <InIMoeK> My production storage runs nexenta
[15:45] <InIMoeK> and all the crap you can get with zfs got me thinking
[15:46] * theTrav (~theTrav@CPE-124-188-218-238.sfcz1.cht.bigpond.net.au) Quit (Read error: Connection timed out)
[15:47] <Sketch> i don't think it buys you anything unless you're going to do raid under ceph
[15:47] <InIMoeK> zfs depends on the configuration ( ARC/L2ARC and SLOG )
[15:47] <InIMoeK> if you dont split those up
[15:47] <InIMoeK> it's no use
[15:48] <InIMoeK> and having 2 file systems that do copy on write
[15:48] <InIMoeK> is a bit redundant too
[15:50] <InIMoeK> and you will have to share allot of mem with the osd deamon
[15:50] <InIMoeK> zfs likes mem
[15:55] * onyb (~ani07nov@119.82.105.66) Quit (Read error: Connection reset by peer)
[15:56] * cronburg (~cronburg@209-6-91-147.c3-0.smr-ubr1.sbo-smr.ma.cable.rcn.com) Quit (Ping timeout: 480 seconds)
[16:00] * zhen (~Thunderbi@117.114.147.135) Quit (Remote host closed the connection)
[16:04] * AluAlu (~Grimhound@91.219.236.222) has joined #ceph
[16:04] * nils_ (~nils_@doomstreet.collins.kg) has joined #ceph
[16:09] * zhen (~Thunderbi@117.114.147.135) has joined #ceph
[16:12] * F|1nt (~F|1nt@host37-212.lan-isdn.imaginet.fr) Quit (Quit: Oups, just gone away...)
[16:13] * vikhyat (~vumrao@121.244.87.116) Quit (Quit: Leaving)
[16:13] * vbellur (~vijay@71.234.224.255) Quit (Ping timeout: 480 seconds)
[16:16] * xarses_ (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[16:17] * Hemanth (~hkumar_@103.228.221.160) has joined #ceph
[16:21] * branto (~branto@ip-78-102-208-181.net.upcbroadband.cz) Quit (Quit: Leaving.)
[16:25] * zhen (~Thunderbi@117.114.147.135) Quit (Quit: zhen)
[16:26] * rraja (~rraja@121.244.87.117) has joined #ceph
[16:26] * karnan (~karnan@121.244.87.117) Quit (Ping timeout: 480 seconds)
[16:28] <rkeene> Grr, I hate Python
[16:28] * dugravot6 (~dugravot6@l-p-dn-in-4a.lionnois.site.univ-lorraine.fr) Quit (Quit: Leaving.)
[16:29] * derjohn_mobi (~aj@x4db124ad.dyn.telefonica.de) has joined #ceph
[16:29] * EthanL (~lamberet@cce02cs4034-fa12-z.ams.hpecore.net) has joined #ceph
[16:31] * bara (~bara@nat-pool-brq-t.redhat.com) Quit (Quit: Bye guys! (??????????????????? ?????????)
[16:31] * yanzheng1 (~zhyan@118.116.114.34) has joined #ceph
[16:31] * vbellur (~vijay@nat-pool-bos-t.redhat.com) has joined #ceph
[16:33] * gregmark (~Adium@68.87.42.115) has joined #ceph
[16:33] * kefu (~kefu@183.193.182.196) has joined #ceph
[16:33] * rraja (~rraja@121.244.87.117) Quit (Quit: Leaving)
[16:33] * haplo37 (~haplo37@107.190.44.23) has joined #ceph
[16:33] * AluAlu (~Grimhound@9YSAAAS60.tor-irc.dnsbl.oftc.net) Quit ()
[16:34] * spate (~galaxyAbs@176.10.99.200) has joined #ceph
[16:35] * yanzheng1 (~zhyan@118.116.114.34) Quit ()
[16:40] * TMM (~hp@185.5.121.201) Quit (Quit: Ex-Chat)
[16:47] * EthanL (~lamberet@cce02cs4034-fa12-z.ams.hpecore.net) Quit (Ping timeout: 480 seconds)
[16:48] * penguinRaider (~KiKo@146.185.31.226) Quit (Ping timeout: 480 seconds)
[16:50] * thomnico (~thomnico@2a01:e35:8b41:120:2411:966a:8740:f9a3) has joined #ceph
[16:51] * TMM (~hp@185.5.121.201) has joined #ceph
[16:52] * EinstCrazy (~EinstCraz@180.173.205.135) has joined #ceph
[16:57] * efirs1 (~firs@31.173.242.249) has joined #ceph
[16:58] * penguinRaider (~KiKo@146.185.31.226) has joined #ceph
[17:02] * cronburg (~cronburg@wr-130-64-194-42.medford.tufts.edu) has joined #ceph
[17:03] * spate (~galaxyAbs@9YSAAAS7Y.tor-irc.dnsbl.oftc.net) Quit ()
[17:04] * cheese^ (~Teddybare@185.100.86.69) has joined #ceph
[17:10] * wushudoin (~wushudoin@2601:646:8281:cfd:2ab2:bdff:fe0b:a6ee) has joined #ceph
[17:17] * rotbeard (~redbeard@185.32.80.238) Quit (Quit: Leaving)
[17:27] * jcsp (~jspray@82-71-16-249.dsl.in-addr.zen.co.uk) Quit (Quit: Ex-Chat)
[17:27] * TMM (~hp@185.5.121.201) Quit (Quit: Ex-Chat)
[17:28] * b0e (~aledermue@213.95.25.82) Quit (Quit: Leaving.)
[17:29] * Miouge (~Miouge@109.128.94.173) Quit (Quit: Miouge)
[17:29] * Miouge (~Miouge@109.128.94.173) has joined #ceph
[17:31] * ira (~ira@nat-pool-bos-t.redhat.com) has joined #ceph
[17:32] * shaunm (~shaunm@74.83.215.100) Quit (Ping timeout: 480 seconds)
[17:33] * Miouge (~Miouge@109.128.94.173) Quit ()
[17:33] * cheese^ (~Teddybare@61TAAASOJ.tor-irc.dnsbl.oftc.net) Quit ()
[17:38] * sudocat (~dibarra@104-188-116-197.lightspeed.hstntx.sbcglobal.net) has joined #ceph
[17:38] * snelly (~cjs@sable.island.nu) Quit (Quit: leaving)
[17:38] <rkeene> Grr, I hate Python so much
[17:38] * snelly (~cjs@sable.island.nu) has joined #ceph
[17:39] <rkeene> The Ceph build system is all broken
[17:39] <ira> rkeene: What are you hitting?
[17:40] <rkeene> ira, It's putting files into /usr/lib and /usr/bin even though I compiled with --prefix=''
[17:40] * ira ews.
[17:40] <rkeene> It even put a file in /usr/sbin when I do --sbindir=/bin
[17:41] <ira> cmake or configure?
[17:41] <rkeene> Configure -- I'm sure CMake is all kinds of broken to hell
[17:41] <ira> rkeene: I'm just getting rpms from ./make-dist to build... that's why I asked ;)
[17:42] <ira> which branch? :)
[17:42] <rkeene> Ceph release 10.2.2
[17:42] * zhen (~Thunderbi@117.114.147.135) has joined #ceph
[17:44] <rkeene> The "rados" python module also never gets installed, which breaks "ceph"
[17:45] <ira> odd...
[17:46] * sudocat (~dibarra@104-188-116-197.lightspeed.hstntx.sbcglobal.net) Quit (Ping timeout: 480 seconds)
[17:46] <rkeene> It tries to determine the host platform by running the "arch" command, which will be wrong
[17:47] <MrBy> It looks like that the garbage collection is not working, I get "RGWGC::process() failed to acquire lock on gc.11" someone has had something similar and knows how to solve it?
[17:47] * hybrid512 (~walid@195.200.189.206) Quit (Remote host closed the connection)
[17:51] * Kitz (~Kitz@admin163-128.hampshire.edu) has joined #ceph
[17:51] * Miouge (~Miouge@109.128.94.173) has joined #ceph
[17:52] <rkeene> Hmm
[17:52] <rkeene> Maybe it's mad I did --without-cython ?
[17:52] * Miouge (~Miouge@109.128.94.173) Quit ()
[17:53] <m0zes> probably. the rados module is all in pyx files. I think those have to be compiled
[17:54] <rkeene> So many ways to build a broken Ceph that used to work.
[17:55] <rkeene> Do I need Cython just for the build system, or for the host system as well ?
[17:55] <m0zes> should just need it for the build system, if I understand how cython works...
[17:55] * Miouge (~Miouge@109.128.94.173) has joined #ceph
[17:56] <rkeene> There's no telling how this will work out since everything is cross-compiled
[17:56] * brad[] (~Brad@24.244.32.53) has joined #ceph
[17:56] * blizzow (~jburns@50.243.148.102) has joined #ceph
[17:56] <brad[]> Is there a way to determine which client is most active on a ceph pool?
[17:56] * linuxkidd (~linuxkidd@ip70-189-207-54.lv.lv.cox.net) Quit (Quit: Leaving)
[17:57] * linuxkidd (~linuxkidd@ip70-189-207-54.lv.lv.cox.net) has joined #ceph
[17:57] * mattch (~mattch@w5430.see.ed.ac.uk) Quit (Remote host closed the connection)
[17:58] * sudocat (~dibarra@192.185.1.20) has joined #ceph
[17:59] <wes_dillingham> on my mon hosts, does it make sense to have all the other mons listed in mon_host in my conf?
[18:00] <wes_dillingham> arent the mon IPs for mons not even lifted from the conf?
[18:01] <m0zes> if you use the ceph command on them, you'll want them there ;)
[18:02] * Miouge (~Miouge@109.128.94.173) Quit (Quit: Miouge)
[18:03] * Miouge (~Miouge@109.128.94.173) has joined #ceph
[18:09] * Miouge (~Miouge@109.128.94.173) Quit (Quit: Miouge)
[18:11] * cathode (~cathode@50.232.215.114) has joined #ceph
[18:22] * krypto (~krypto@G68-90-105-137.sbcis.sbc.com) has joined #ceph
[18:29] * Miouge (~Miouge@109.128.94.173) has joined #ceph
[18:35] * vasu (~vasu@c-73-231-60-138.hsd1.ca.comcast.net) has joined #ceph
[18:36] * sugoruyo (~georgev@paarthurnax.esc.rl.ac.uk) Quit (Quit: I'm going home!)
[18:38] * Bored (~nupanick@tor2e1.privacyfoundation.ch) has joined #ceph
[18:40] * wjw-freebsd (~wjw@smtp.digiware.nl) has joined #ceph
[18:41] * danieagle (~Daniel@177.188.67.145) Quit (Quit: Obrigado por Tudo! :-) inte+ :-))
[18:42] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:454c:daa6:f349:3b58) Quit (Ping timeout: 480 seconds)
[18:43] <rkeene> So, what's the correct way to tell Ceph --prefix='' --bindir=/bin because currently it installs some things correctly and some things in /usr/bin, /usr/sbin, /usr/lib for no good reason
[18:44] * xarses_ (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) has joined #ceph
[18:45] * Miouge (~Miouge@109.128.94.173) Quit (Quit: Miouge)
[18:46] * shaunm (~shaunm@cpe-192-180-17-174.kya.res.rr.com) has joined #ceph
[18:52] * zhen (~Thunderbi@117.114.147.135) Quit (Ping timeout: 480 seconds)
[18:58] <m0zes> rkeene: I'd be tempted to read through the gentoo ebuild for 10.2.2, as they compile everything from source and handle the install phase themselves. https://gitweb.gentoo.org/repo/gentoo.git/tree/sys-cluster/ceph/ceph-10.2.2-r1.ebuild
[18:58] * Miouge (~Miouge@109.128.94.173) has joined #ceph
[18:58] * karnan (~karnan@106.51.137.148) has joined #ceph
[19:00] <rkeene> m0zes, They don't use --prefix='' --sbindir=/bin and are probably okay with things getting put into /usr (which I don't have/support) and /usr/sbin or /sbin (which I don't have/support)
[19:02] * xarses_ (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[19:08] * Bored (~nupanick@9YSAAATCF.tor-irc.dnsbl.oftc.net) Quit ()
[19:10] * bene2 (~bene@2601:193:4101:f410:ea2a:eaff:fe08:3c7a) Quit (Quit: Konversation terminated!)
[19:14] * xarses_ (~xarses@64.124.158.100) has joined #ceph
[19:15] * dillaman (~jdillaman@pool-108-18-97-95.washdc.fios.verizon.net) Quit (Quit: Leaving)
[19:19] * Miouge (~Miouge@109.128.94.173) Quit (Quit: Miouge)
[19:29] * InIMoeK (~InIMoeK@95.170.93.16) Quit (Ping timeout: 480 seconds)
[19:32] * debian112 (~bcolbert@173-164-167-201-SFBA.hfc.comcastbusiness.net) Quit (Quit: Leaving.)
[19:38] * reed (~reed@184-23-0-196.dsl.static.fusionbroadband.com) has joined #ceph
[19:39] * TMM (~hp@178-84-46-106.dynamic.upc.nl) has joined #ceph
[19:51] * EinstCrazy (~EinstCraz@180.173.205.135) Quit (Remote host closed the connection)
[19:54] * thomnico (~thomnico@2a01:e35:8b41:120:2411:966a:8740:f9a3) Quit (Quit: Ex-Chat)
[19:56] * kefu (~kefu@183.193.182.196) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[19:57] * newbie (~kvirc@host217-114-156-249.pppoe.mark-itt.net) has joined #ceph
[20:00] * gwinger (~gwinger@ip5f5be40b.dynamic.kabel-deutschland.de) Quit (Quit: This computer has gone to sleep)
[20:00] * gwinger (~gwinger@2a02:8108:42c0:a68:39a7:5fab:1f6c:4d56) has joined #ceph
[20:00] * Jeffrey4l_ (~Jeffrey@120.10.244.6) Quit (Ping timeout: 480 seconds)
[20:00] * haplo37 (~haplo37@107.190.44.23) Quit (Remote host closed the connection)
[20:02] * gwinger_ (~gwinger@ip5f5be40b.dynamic.kabel-deutschland.de) has joined #ceph
[20:04] * gwinger_ (~gwinger@ip5f5be40b.dynamic.kabel-deutschland.de) Quit ()
[20:04] * nils_ (~nils_@doomstreet.collins.kg) Quit (Quit: This computer has gone to sleep)
[20:06] * penguinRaider (~KiKo@146.185.31.226) Quit (Ping timeout: 480 seconds)
[20:06] * vbellur (~vijay@nat-pool-bos-t.redhat.com) Quit (Ping timeout: 480 seconds)
[20:07] * ira (~ira@nat-pool-bos-t.redhat.com) Quit (Ping timeout: 480 seconds)
[20:08] * gwinger (~gwinger@2a02:8108:42c0:a68:39a7:5fab:1f6c:4d56) Quit (Ping timeout: 480 seconds)
[20:16] * nass5 (~fred@l-p-dn-in-12a.lionnois.site.univ-lorraine.fr) Quit (Ping timeout: 480 seconds)
[20:21] * penguinRaider (~KiKo@146.185.31.226) has joined #ceph
[20:21] * vbellur (~vijay@nat-pool-bos-u.redhat.com) has joined #ceph
[20:23] * cathode (~cathode@50.232.215.114) Quit (Quit: Leaving)
[20:25] <Kitz> I'm having some trouble with one of my ceph clients not being able to run start rbdmap (or run ceph or rbd) while other are ok. I'm getting "init: rbdmap pre-start process (25222) terminated with status 5" with rbdmap and ceph/rbd just hang. :(
[20:26] * jermudgeon (~jhaustin@wpc-pe-l2.whitestone.link) has joined #ceph
[20:29] * karnan (~karnan@106.51.137.148) Quit (Remote host closed the connection)
[20:30] * linuxkidd (~linuxkidd@ip70-189-207-54.lv.lv.cox.net) Quit (Quit: Leaving)
[20:36] * nils_ (~nils_@doomstreet.collins.kg) has joined #ceph
[20:39] * linuxkidd (~linuxkidd@mobile-166-176-59-28.mycingular.net) has joined #ceph
[20:45] * jermudgeon (~jhaustin@wpc-pe-l2.whitestone.link) Quit (Quit: jermudgeon)
[20:45] * rwheeler (~rwheeler@nat-pool-bos-t.redhat.com) Quit (Quit: Leaving)
[20:48] <rkeene> I opened bug reports for the issues I could remember from the build
[20:49] * Guest2759 is now known as herrsergio
[20:50] * pvsa (~pvsa@tmo-104-247.customers.d1-online.com) has joined #ceph
[20:50] * jermudgeon (~jhaustin@wpc-pe-l2.whitestone.link) has joined #ceph
[20:51] * efirs1 (~firs@31.173.242.249) Quit (Ping timeout: 480 seconds)
[20:52] <johnavp1989> Hello. My cephfs filesystem is hanging. Can't write to it from a host using the kernel module. Output of ceph status reports mds cluster is degraded
[20:52] <johnavp1989> Can anyone tell me how I can restore it to a good state?
[20:52] * jermudgeon (~jhaustin@wpc-pe-l2.whitestone.link) Quit ()
[20:57] <rkeene> Why is the MDS degraded ?
[21:02] <johnavp1989> rkeene: I restarted it. I was having problems writing to the volume using the kernel module on ubuntu 16.04
[21:02] <johnavp1989> The mds logs show slow request 3842.104619 seconds old
[21:04] <rkeene> ceph health detail and ceph mds stat output somewhere ?
[21:06] <johnavp1989> rkeene: http://pastebin.com/7t2hjphp
[21:06] * pvsa (~pvsa@tmo-104-247.customers.d1-online.com) Quit (Remote host closed the connection)
[21:07] <rkeene> johnavp1989, http://www.spinics.net/lists/ceph-devel/msg28012.html http://tracker.ceph.com/issues/13167 ?
[21:10] * bniver (~bniver@71-9-144-29.static.oxfr.ma.charter.com) Quit (Ping timeout: 480 seconds)
[21:14] <johnavp1989> rkeene: So i see that a fix has already been merged. Don't see why I would encounter that bug I'm running 10.2.2. Cluster is only 30 days old
[21:15] <rkeene> Are you having the same log entries as described in the post ?
[21:21] * vbellur (~vijay@nat-pool-bos-u.redhat.com) Quit (Ping timeout: 480 seconds)
[21:21] * bniver (~bniver@71-9-144-29.static.oxfr.ma.charter.com) has joined #ceph
[21:22] <johnavp1989> rkeene: only thing I have in the logs are the slow request messages
[21:23] <johnavp1989> http://pastebin.com/3xU86Lud
[21:25] <rkeene> Any OSD fullness issues or anything ?
[21:27] <johnavp1989> nope OSD's are good. this isn't in production. there's not data on it
[21:27] * salwasser (~Adium@72.246.3.14) Quit (Quit: Leaving.)
[21:28] * valeech (~valeech@pool-108-44-162-111.clppva.fios.verizon.net) Quit (Quit: valeech)
[21:28] <johnavp1989> I checked the health of the disks also and they all report healthy. I don't see any iowait to any of them
[21:34] * vbellur (~vijay@nat-pool-bos-t.redhat.com) has joined #ceph
[21:35] * InIMoeK (~InIMoeK@105-183-045-062.dynamic.caiway.nl) has joined #ceph
[21:36] * jermudgeon (~jhaustin@wpc-pe-l2.whitestone.link) has joined #ceph
[21:37] * KindOne_ (kindone@h29.170.16.98.dynamic.ip.windstream.net) has joined #ceph
[21:38] * valeech (~valeech@pool-108-44-162-111.clppva.fios.verizon.net) has joined #ceph
[21:38] * jdillaman (~jdillaman@pool-108-18-97-95.washdc.fios.verizon.net) Quit (Quit: jdillaman)
[21:40] * davidzlap (~Adium@cpe-76-91-38-249.socal.res.rr.com) has joined #ceph
[21:41] * linuxkidd (~linuxkidd@mobile-166-176-59-28.mycingular.net) Quit (Quit: Leaving)
[21:43] * linuxkidd (~linuxkidd@ip70-189-207-54.lv.lv.cox.net) has joined #ceph
[21:43] * KindOne (kindone@0001a7db.user.oftc.net) Quit (Ping timeout: 480 seconds)
[21:43] * KindOne_ is now known as KindOne
[21:44] * jermudgeon (~jhaustin@wpc-pe-l2.whitestone.link) Quit (Quit: jermudgeon)
[21:48] <rkeene> The Ceph build system is just so much fail
[21:51] * dyasny (~dyasny@cable-192.222.152.136.electronicbox.net) has joined #ceph
[21:51] * rendar (~I@host230-180-dynamic.12-79-r.retail.telecomitalia.it) Quit (Ping timeout: 480 seconds)
[21:51] * jermudgeon (~jhaustin@wpc-pe-l2.whitestone.link) has joined #ceph
[21:55] <ceph-ircslackbot> <vdb> rkeene: No more better reason to fix it. ;)
[21:55] <rkeene> Yeah, I'm filing bug reports now -- up to 10
[21:58] * InIMoeK (~InIMoeK@105-183-045-062.dynamic.caiway.nl) Quit (Ping timeout: 480 seconds)
[22:00] * IvanJobs (~ivanjobs@103.50.11.146) Quit (Read error: Connection reset by peer)
[22:00] * IvanJobs (~ivanjobs@122.14.140.7) has joined #ceph
[22:00] * Miouge (~Miouge@109.128.94.173) has joined #ceph
[22:03] * brad_mssw (~brad@66.129.88.50) Quit (Quit: Leaving)
[22:04] * vbellur (~vijay@nat-pool-bos-t.redhat.com) Quit (Ping timeout: 480 seconds)
[22:05] * dneary (~dneary@nat-pool-bos-u.redhat.com) Quit (Ping timeout: 480 seconds)
[22:08] * Jeeves_ (~mark@2a03:7900:1:1:4cac:cad7:939b:67f4) Quit (Ping timeout: 480 seconds)
[22:09] * wjw-freebsd2 (~wjw@smtp.digiware.nl) has joined #ceph
[22:11] * Jeeves_ (~mark@2a03:7900:1:1:4cac:cad7:939b:67f4) has joined #ceph
[22:11] * IvanJobs (~ivanjobs@122.14.140.7) Quit (Read error: Connection reset by peer)
[22:13] * IvanJobs (~ivanjobs@103.50.11.146) has joined #ceph
[22:14] * wjw-freebsd (~wjw@smtp.digiware.nl) Quit (Ping timeout: 480 seconds)
[22:15] * nils_ (~nils_@doomstreet.collins.kg) Quit (Quit: This computer has gone to sleep)
[22:15] * jermudgeon (~jhaustin@wpc-pe-l2.whitestone.link) Quit (Quit: jermudgeon)
[22:15] * Hemanth (~hkumar_@103.228.221.160) Quit (Remote host closed the connection)
[22:17] * rendar (~I@host230-180-dynamic.12-79-r.retail.telecomitalia.it) has joined #ceph
[22:18] * wgao (~wgao@106.120.101.38) Quit (Ping timeout: 480 seconds)
[22:18] <rkeene> http://tracker.ceph.com/issues/16791 http://tracker.ceph.com/issues/16790 http://tracker.ceph.com/issues/16789 http://tracker.ceph.com/issues/16788 http://tracker.ceph.com/issues/16787 http://tracker.ceph.com/issues/16786 http://tracker.ceph.com/issues/16785 http://tracker.ceph.com/issues/16784 http://tracker.ceph.com/issues/16783 http://tracker.ceph.com/issues/16782
[22:23] * niknakpaddywak (~xander.ni@outbound.lax.demandmedia.com) has joined #ceph
[22:26] * nass5 (~fred@l-p-dn-in-12a.lionnois.site.univ-lorraine.fr) has joined #ceph
[22:27] * Miouge (~Miouge@109.128.94.173) Quit (Quit: Miouge)
[22:30] * wgao (~wgao@106.120.101.38) has joined #ceph
[22:32] * Miouge (~Miouge@109.128.94.173) has joined #ceph
[22:33] * ira (~ira@c-24-34-255-34.hsd1.ma.comcast.net) has joined #ceph
[22:34] * Miouge (~Miouge@109.128.94.173) Quit ()
[22:34] * IvanJobs (~ivanjobs@103.50.11.146) Quit (Read error: Connection reset by peer)
[22:35] * Miouge (~Miouge@109.128.94.173) has joined #ceph
[22:35] * IvanJobs (~ivanjobs@103.50.11.146) has joined #ceph
[22:38] * bla (~b.laessig@chimeria.ext.pengutronix.de) Quit (Ping timeout: 480 seconds)
[22:38] * bla (~b.laessig@chimeria.ext.pengutronix.de) has joined #ceph
[22:40] * IvanJobs (~ivanjobs@103.50.11.146) Quit (Read error: Connection reset by peer)
[22:41] * jermudgeon (~jhaustin@wpc-pe-l2.whitestone.link) has joined #ceph
[22:41] * Miouge (~Miouge@109.128.94.173) Quit (Quit: Miouge)
[22:41] * IvanJobs (~ivanjobs@122.14.140.7) has joined #ceph
[22:42] * jermudgeon (~jhaustin@wpc-pe-l2.whitestone.link) Quit ()
[22:43] * jermudgeon (~jhaustin@wpc-pe-l2.whitestone.link) has joined #ceph
[22:43] * IvanJobs (~ivanjobs@122.14.140.7) Quit (Read error: Connection reset by peer)
[22:44] * IvanJobs (~ivanjobs@103.50.11.146) has joined #ceph
[22:53] * bniver (~bniver@71-9-144-29.static.oxfr.ma.charter.com) Quit (Remote host closed the connection)
[22:55] * johnavp1989 (~jpetrini@8.39.115.8) Quit (Ping timeout: 480 seconds)
[22:57] * wes_dillingham (~wes_dilli@65.112.8.203) Quit (Quit: wes_dillingham)
[23:05] * jermudgeon (~jhaustin@wpc-pe-l2.whitestone.link) Quit (Read error: No route to host)
[23:06] * swsgc (swsgc@c-71-237-134-29.hsd1.or.comcast.net) has joined #ceph
[23:06] * jermudgeon (~jhaustin@31.207.56.59) has joined #ceph
[23:09] <swsgc> hey.. so, i want to mirror one directory onto 3 servers (they are all linux boxes). thats it, I want the boxes to run as usual otherwise. So, this seems like a very simple task for ceph. can anyone suggest a tutorial page or howto that will show how to do the simple setup I want? I have found plenty of complex docs.. but i just need a simple implementation.
[23:10] <swsgc> additional info, that directory will have files added/removed/changed from all 3 servers
[23:14] * jermudgeon (~jhaustin@31.207.56.59) Quit (Quit: jermudgeon)
[23:14] * jermudgeon (~jhaustin@31.207.56.59) has joined #ceph
[23:15] * overclk (~quassel@2400:6180:100:d0::54:1) Quit (Quit: No Ping reply in 180 seconds.)
[23:15] * nils_ (~nils_@doomstreet.collins.kg) has joined #ceph
[23:16] <blizzow> Can I specify which OSDs belong to which pool? I have a wad of SSDs that I want to use for a Ceph Pool and a set of spinner disks that I want to use for a different pool.
[23:16] * overclk (~quassel@2400:6180:100:d0::54:1) has joined #ceph
[23:17] <m0zes> blizzow: https://www.sebastien-han.fr/blog/2014/08/25/ceph-mix-sata-and-ssd-within-the-same-box/
[23:21] * rakeshgm (~rakesh@106.51.225.17) Quit (Quit: Leaving)
[23:22] * jermudgeon (~jhaustin@31.207.56.59) Quit (Quit: jermudgeon)
[23:32] * MentalRay (~MentalRay@209.171.88.177) has joined #ceph
[23:36] * shaunm (~shaunm@cpe-192-180-17-174.kya.res.rr.com) Quit (Ping timeout: 480 seconds)
[23:39] * mattbenjamin (~mbenjamin@12.118.3.106) Quit (Quit: Leaving.)
[23:40] * MentalRay (~MentalRay@209.171.88.177) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[23:43] * theTrav (~theTrav@CPE-124-188-218-238.sfcz1.cht.bigpond.net.au) has joined #ceph
[23:43] * gregmark (~Adium@68.87.42.115) Quit (Quit: Leaving.)
[23:44] * vbellur (~vijay@71.234.224.255) has joined #ceph
[23:44] * MentalRay (~MentalRay@47.54.105.247) has joined #ceph
[23:48] * MentalRay (~MentalRay@47.54.105.247) Quit ()

These logs were automatically created by CephLogBot on irc.oftc.net using the Java IRC LogBot.