#ceph IRC Log

Index

IRC Log for 2016-05-31

Timestamps are in GMT/BST.

[0:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[0:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[0:02] * Lokta (~Lokta@carbon.coe.int) Quit (Ping timeout: 480 seconds)
[0:06] * hemebond (~james@121.98.140.35) has joined #ceph
[0:06] <hemebond> Is it correct that all Ceph logging (to syslog) is at severity 0 (emergency) and there's no way to change it?
[0:09] * thansen (~thansen@17.253.sfcn.org) Quit (Quit: Ex-Chat)
[0:15] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[0:16] * allaok1 (~allaok@ARennes-658-1-51-67.w2-13.abo.wanadoo.fr) has joined #ceph
[0:16] * allaok1 (~allaok@ARennes-658-1-51-67.w2-13.abo.wanadoo.fr) has left #ceph
[0:17] * newbie (~kvirc@host217-114-156-249.pppoe.mark-itt.net) Quit (Ping timeout: 480 seconds)
[0:19] * jermudgeon (~jhaustin@wpc-pe-l2.whitestone.link) has joined #ceph
[0:21] * kalleeen (~AG_Clinto@06SAAC9B9.tor-irc.dnsbl.oftc.net) Quit ()
[0:34] * nagyz (~textual@109.74.56.122) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[0:34] * nagyz (~textual@109.74.56.122) has joined #ceph
[0:45] * danieagle (~Daniel@179.110.89.229) has joined #ceph
[0:45] * nagyz (~textual@109.74.56.122) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[0:58] * johnavp19891 (~jpetrini@pool-100-14-10-2.phlapa.fios.verizon.net) Quit (Ping timeout: 480 seconds)
[1:01] * fsimonce (~simon@host128-29-dynamic.250-95-r.retail.telecomitalia.it) Quit (Quit: Coyote finally caught me)
[1:03] * ircuser-1 (~Johnny@158.183-62-69.ftth.swbr.surewest.net) has joined #ceph
[1:09] * stiopa (~stiopa@cpc73832-dals21-2-0-cust453.20-2.cable.virginm.net) Quit (Ping timeout: 480 seconds)
[1:16] * al (d@niel.cx) has joined #ceph
[1:16] * al (d@niel.cx) Quit (Read error: Connection reset by peer)
[1:19] * al (d@niel.cx) has joined #ceph
[1:21] * dgurtner (~dgurtner@178.197.239.57) Quit (Ping timeout: 480 seconds)
[1:22] * MentalRay (~MentalRay@MTRLPQ42-1176054809.sdsl.bell.ca) Quit (Ping timeout: 480 seconds)
[1:25] * danielsj (~Architect@anonymous.sec.nl) has joined #ceph
[1:26] * oms101 (~oms101@p20030057EA4E9700C6D987FFFE4339A1.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[1:34] * oms101 (~oms101@p20030057EA07D400C6D987FFFE4339A1.dip0.t-ipconnect.de) has joined #ceph
[1:41] * abeck (~textual@213.152.161.40) Quit (Ping timeout: 480 seconds)
[1:55] * danielsj (~Architect@06SAAC9FP.tor-irc.dnsbl.oftc.net) Quit ()
[1:55] * LRWerewolf (~Bored@109.201.133.100) has joined #ceph
[1:58] <portante> hemebond: I believe that has been fixed
[1:58] <hemebond> In jewel or something?
[1:58] <portante> if you want I can dig up the change
[1:58] <portante> I am not sure where it landed
[1:58] <portante> I'd have to find the change request
[1:58] <hemebond> That's fine. Thanks. I'll try and upgrade.
[1:58] <portante> if you look for syslog you should find it
[1:58] <hemebond> Thanks.
[1:59] <portante> welcome
[2:00] <raeven> I read somewhere that erasure coding can't be used with cephfs. Is this true or am I thinging of something else?
[2:00] <hemebond> "Release: next" so I'm assuming Jewel (which comes after Hammer I think)
[2:01] <hemebond> Oh it was backported. Neat.
[2:07] <raeven> Well, it complained when i tried to use erasure so I guess i was right.
[2:07] <hemebond> portante: Do you know if you can quiet the logs at all? I don't need debug info.
[2:08] <portante> hemebond: what is your operating environment?
[2:08] <portante> a systemd based systemd?
[2:08] <portante> system
[2:11] * ronrib (~boswortr@45.32.242.135) has joined #ceph
[2:11] * PoRNo-MoRoZ (~hp1ng@mail.ap-team.ru) Quit (Ping timeout: 480 seconds)
[2:11] * PoRNo-MoRoZ (~hp1ng@5.101.207.18) has joined #ceph
[2:14] <raeven> Is it possible to have a size of 4 on a pool and only allow that max 2 can be on a single host?
[2:22] * jermudgeon (~jhaustin@wpc-pe-l2.whitestone.link) Quit (Quit: jermudgeon)
[2:25] * LRWerewolf (~Bored@06SAAC9GW.tor-irc.dnsbl.oftc.net) Quit ()
[2:25] * ylmson (~Kottizen@atlantic850.dedicatedpanel.com) has joined #ceph
[2:26] * huangjun (~kvirc@113.57.168.154) has joined #ceph
[2:31] * danieagle (~Daniel@179.110.89.229) Quit (Remote host closed the connection)
[2:41] * povian (~povian@211.189.163.250) has joined #ceph
[2:53] * johnavp1989 (~jpetrini@pool-100-14-10-2.phlapa.fios.verizon.net) has joined #ceph
[2:53] <- *johnavp1989* To prove that you are human, please enter the result of 8+3
[2:55] * ylmson (~Kottizen@4MJAAFREE.tor-irc.dnsbl.oftc.net) Quit ()
[2:55] * Qiasfah (~Pulec@163.172.152.231) has joined #ceph
[3:00] * mhuang (~mhuang@101.36.77.179) has joined #ceph
[3:00] * povian (~povian@211.189.163.250) Quit (Remote host closed the connection)
[3:12] * danieagle (~Daniel@179.110.89.229) has joined #ceph
[3:13] * mhuang (~mhuang@101.36.77.179) Quit (Quit: This computer has gone to sleep)
[3:19] * huangjun (~kvirc@113.57.168.154) Quit (Read error: Connection reset by peer)
[3:20] * neurodrone_ (~neurodron@162.243.191.67) Quit (Quit: neurodrone_)
[3:21] * georgem (~Adium@104-222-119-175.cpe.teksavvy.com) has joined #ceph
[3:25] * EinstCrazy (~EinstCraz@58.247.119.250) has joined #ceph
[3:25] * Qiasfah (~Pulec@4MJAAFRFH.tor-irc.dnsbl.oftc.net) Quit ()
[3:25] * hoopy (~Curt`@192.42.115.101) has joined #ceph
[3:40] <badone> raeven: I think with the right crushmap. Here's a discussion of something similar https://www.mail-archive.com/ceph-users@lists.ceph.com/msg19140.html
[3:42] * johnavp1989 (~jpetrini@pool-100-14-10-2.phlapa.fios.verizon.net) Quit (Ping timeout: 480 seconds)
[3:46] * m0zes (~mozes@ns1.beocat.ksu.edu) Quit (Ping timeout: 480 seconds)
[3:49] * zhaochao (~zhaochao@125.39.9.148) has joined #ceph
[3:55] * timmy (~oftc-webi@rz16.vpn.hetzner.de) Quit (Ping timeout: 480 seconds)
[3:55] * hoopy (~Curt`@4MJAAFRGP.tor-irc.dnsbl.oftc.net) Quit ()
[3:55] * LorenXo (~Malcovent@relay1.cavefelem.com) has joined #ceph
[4:01] * mhuang (~mhuang@119.254.120.71) has joined #ceph
[4:06] * m0zes (~mozes@ns1.beocat.ksu.edu) has joined #ceph
[4:08] * espeer_ (~quassel@phobos.isoho.st) Quit (Ping timeout: 481 seconds)
[4:12] * mhuang_ (~mhuang@119.254.120.71) has joined #ceph
[4:13] * espeer (~quassel@phobos.isoho.st) has joined #ceph
[4:16] * mhuang (~mhuang@119.254.120.71) Quit (Ping timeout: 480 seconds)
[4:19] * yanzheng (~zhyan@118.116.112.223) has joined #ceph
[4:20] * bene (~bene@2601:18c:8501:41d0:ea2a:eaff:fe08:3c7a) has joined #ceph
[4:23] <hemebond> portante: Ubuntu Trusty; uses Upstart.
[4:25] * LorenXo (~Malcovent@4MJAAFRHW.tor-irc.dnsbl.oftc.net) Quit ()
[4:25] * Inuyasha1 (~xanax`@185.36.100.145) has joined #ceph
[4:30] * vicente (~~vicente@125-227-238-55.HINET-IP.hinet.net) has joined #ceph
[4:31] * vbellur (~vijay@2601:18f:700:55b0:5e51:4fff:fee8:6a5c) has joined #ceph
[4:36] * neurodrone_ (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) has joined #ceph
[4:37] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[4:37] * flisky (~Thunderbi@36.110.40.28) has joined #ceph
[4:41] * khyron (~khyron@fixed-190-159-187-190-159-75.iusacell.net) has joined #ceph
[4:44] * MentalRay (~MentalRay@107.171.161.165) has joined #ceph
[4:45] * rossdylan (rossdylan@losna.helixoide.com) Quit (Ping timeout: 480 seconds)
[4:51] * kefu (~kefu@183.193.182.2) has joined #ceph
[4:55] * Inuyasha1 (~xanax`@7V7AAFG8Z.tor-irc.dnsbl.oftc.net) Quit ()
[4:55] * jakekosberg1 (~Drezil@chomsky.torservers.net) has joined #ceph
[5:04] <portante> hemebond: I am not familiar with upstart, but check to see if upstart takes any different behavior with "emerg" level log messages, as systemd's journald does (every emerg messages results in an fsync, I believe)
[5:04] * EinstCrazy (~EinstCraz@58.247.119.250) Quit (Ping timeout: 480 seconds)
[5:04] <hemebond> Oh, so filter at the syslog/startup level? I'll look into that, thanks.
[5:05] <portante> welcome
[5:05] * huangjun (~kvirc@113.57.168.154) has joined #ceph
[5:09] * Vacuum_ (~Vacuum@88.130.210.121) has joined #ceph
[5:10] * bjozet_ (~bjozet@82-183-17-144.customers.ownit.se) has joined #ceph
[5:12] * bjozet (~bjozet@82-183-17-144.customers.ownit.se) Quit (Ping timeout: 480 seconds)
[5:16] * Vacuum__ (~Vacuum@i59F7938F.versanet.de) Quit (Ping timeout: 480 seconds)
[5:17] * jermudgeon (~jhaustin@southend.mdu.whitestone.link) has joined #ceph
[5:23] * neurodrone_ (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) Quit (Quit: neurodrone_)
[5:25] * jermudgeon (~jhaustin@southend.mdu.whitestone.link) Quit (Quit: jermudgeon)
[5:25] * jakekosberg1 (~Drezil@4MJAAFRKD.tor-irc.dnsbl.oftc.net) Quit ()
[5:25] * Arfed (~mrapple@95.128.43.164) has joined #ceph
[5:29] * deepthi (~deepthi@122.171.82.204) has joined #ceph
[5:30] * EinstCrazy (~EinstCraz@58.247.119.250) has joined #ceph
[5:34] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[5:35] * kefu_ (~kefu@114.92.122.74) has joined #ceph
[5:36] * _28_ria (~kvirc@opfr028.ru) Quit (Read error: Connection reset by peer)
[5:37] * _28_ria (~kvirc@opfr028.ru) has joined #ceph
[5:37] * kefu (~kefu@183.193.182.2) Quit (Ping timeout: 480 seconds)
[5:38] * lxo (~aoliva@lxo.user.oftc.net) Quit (Remote host closed the connection)
[5:39] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[5:39] * ycheng (~ycheng@122.146.93.152) Quit (Quit: Leaving)
[5:40] * MentalRay (~MentalRay@107.171.161.165) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[5:44] * bene (~bene@2601:18c:8501:41d0:ea2a:eaff:fe08:3c7a) Quit (Quit: Konversation terminated!)
[5:45] * georgem (~Adium@104-222-119-175.cpe.teksavvy.com) Quit (Quit: Leaving.)
[5:48] * vicente (~~vicente@125-227-238-55.HINET-IP.hinet.net) Quit (Read error: Connection reset by peer)
[5:49] * vicente (~~vicente@125-227-238-55.HINET-IP.hinet.net) has joined #ceph
[5:54] * shyu (~shyu@218.241.172.114) has joined #ceph
[5:55] * Arfed (~mrapple@7V7AAFHA2.tor-irc.dnsbl.oftc.net) Quit ()
[5:55] * Xa (~mog_@node1.tor-relay.xyz) has joined #ceph
[6:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[6:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[6:01] * ntpttr_laptop (~ntpttr@192.55.54.43) has joined #ceph
[6:25] * ircuser-1 (~Johnny@158.183-62-69.ftth.swbr.surewest.net) Quit (Quit: because)
[6:25] * Xa (~mog_@4MJAAFRL5.tor-irc.dnsbl.oftc.net) Quit ()
[6:25] * Esvandiary (~Zeis@atlantic480.us.unmetered.com) has joined #ceph
[6:30] * ntpttr_laptop (~ntpttr@192.55.54.43) Quit (Ping timeout: 480 seconds)
[6:32] * huangjun|2 (~kvirc@113.57.168.154) has joined #ceph
[6:32] * huangjun (~kvirc@113.57.168.154) Quit (Read error: Connection reset by peer)
[6:34] * mhuang__ (~mhuang@119.254.120.72) has joined #ceph
[6:35] * IvanJobs (~ivanjobs@103.50.11.146) has joined #ceph
[6:36] * prallab (~prallab@216.207.42.137) has joined #ceph
[6:36] <IvanJobs> hello, cephers
[6:38] * lxo (~aoliva@lxo.user.oftc.net) Quit (Remote host closed the connection)
[6:39] * mhuang (~mhuang@119.254.120.72) has joined #ceph
[6:39] * mhuang_ (~mhuang@119.254.120.71) Quit (Ping timeout: 480 seconds)
[6:40] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[6:40] * wjw-freebsd (~wjw@smtp.digiware.nl) Quit (Ping timeout: 480 seconds)
[6:42] * mhuang__ (~mhuang@119.254.120.72) Quit (Ping timeout: 480 seconds)
[6:43] * deepthi (~deepthi@122.171.82.204) Quit (Ping timeout: 480 seconds)
[6:44] * lxo (~aoliva@lxo.user.oftc.net) Quit (Remote host closed the connection)
[6:46] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[6:52] * IvanJobs (~ivanjobs@103.50.11.146) Quit (Remote host closed the connection)
[6:53] * deepthi (~deepthi@122.171.69.55) has joined #ceph
[6:54] * prallab (~prallab@216.207.42.137) Quit (Remote host closed the connection)
[6:54] * shyu (~shyu@218.241.172.114) Quit (Ping timeout: 480 seconds)
[6:55] * Esvandiary (~Zeis@7V7AAFHCY.tor-irc.dnsbl.oftc.net) Quit ()
[6:55] * prallab (~prallab@216.207.42.137) has joined #ceph
[6:55] * xanax` (~Pommesgab@hessel3.torservers.net) has joined #ceph
[7:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[7:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[7:01] * povian (~povian@211.189.163.250) has joined #ceph
[7:02] * shyu (~shyu@218.241.172.114) has joined #ceph
[7:07] * gauravbafna (~gauravbaf@49.32.0.40) has joined #ceph
[7:09] * povian (~povian@211.189.163.250) Quit (Ping timeout: 480 seconds)
[7:11] * TomasCZ (~TomasCZ@yes.tenlab.net) Quit (Quit: Leaving)
[7:13] * vikhyat (~vumrao@121.244.87.116) has joined #ceph
[7:18] * ade (~abradshaw@dslb-094-222-177-039.094.222.pools.vodafone-ip.de) has joined #ceph
[7:20] * shyu (~shyu@218.241.172.114) Quit (Ping timeout: 480 seconds)
[7:22] * nils_ (~nils_@doomstreet.collins.kg) has joined #ceph
[7:24] * IvanJobs (~ivanjobs@103.50.11.146) has joined #ceph
[7:25] * xanax` (~Pommesgab@7V7AAFHD1.tor-irc.dnsbl.oftc.net) Quit ()
[7:30] * rdas (~rdas@121.244.87.116) has joined #ceph
[7:36] * shyu (~shyu@218.241.172.114) has joined #ceph
[7:39] * Thononain1 (~nicatronT@tor-exit1-readme.dfri.se) has joined #ceph
[7:42] * _28_ria (~kvirc@opfr028.ru) Quit (Quit: KVIrc 4.2.0 Equilibrium http://www.kvirc.net/)
[7:53] * kefu_ is now known as kefu
[7:58] * kawa2014 (~kawa@89.184.114.246) has joined #ceph
[7:58] * Kurt (~Adium@2001:628:1:5:185a:b838:e0c2:6177) Quit (Quit: Leaving.)
[8:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[8:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[8:04] * prallab (~prallab@216.207.42.137) Quit (Remote host closed the connection)
[8:04] * Lokta (~Lokta@carbon.coe.int) has joined #ceph
[8:06] * Be-El (~blinke@nat-router.computational.bio.uni-giessen.de) has joined #ceph
[8:06] * nagyz (~textual@109.74.56.122) has joined #ceph
[8:09] * Thononain1 (~nicatronT@7V7AAFHFC.tor-irc.dnsbl.oftc.net) Quit ()
[8:09] * bvi (~Bastiaan@185.56.32.1) has joined #ceph
[8:12] * overclk (~quassel@121.244.87.117) has joined #ceph
[8:13] * post-factum (~post-fact@vulcan.natalenko.name) Quit (Killed (NickServ (Too many failed password attempts.)))
[8:13] * post-factum (~post-fact@vulcan.natalenko.name) has joined #ceph
[8:17] * wjw-freebsd (~wjw@smtp.digiware.nl) has joined #ceph
[8:20] * Miouge (~Miouge@188.189.75.139) has joined #ceph
[8:23] * prallab (~prallab@216.207.42.137) has joined #ceph
[8:25] * DV (~veillard@2001:41d0:a:f29f::1) Quit (Ping timeout: 480 seconds)
[8:32] * inf_b (~o_O@dot1x-170-217.wlan.uni-giessen.de) has joined #ceph
[8:35] * branto (~branto@ip-78-102-208-181.net.upcbroadband.cz) has joined #ceph
[8:35] * flisky (~Thunderbi@36.110.40.28) Quit (Quit: flisky)
[8:35] * yatin (~yatin@161.163.44.8) has joined #ceph
[8:36] * matejz (~matejz@141.255.254.208) has joined #ceph
[8:37] * nagyz (~textual@109.74.56.122) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[8:43] * madkiss (~madkiss@ip5b414c62.dynamic.kabel-deutschland.de) has joined #ceph
[8:45] * madkiss1 (~madkiss@ip5b414c62.dynamic.kabel-deutschland.de) has joined #ceph
[8:45] * madkiss (~madkiss@ip5b414c62.dynamic.kabel-deutschland.de) Quit (Read error: Connection reset by peer)
[8:45] * dugravot6 (~dugravot6@dn-infra-04.lionnois.site.univ-lorraine.fr) has joined #ceph
[8:46] * Hemanth (~hkumar_@121.244.87.118) has joined #ceph
[8:50] * Hemanth (~hkumar_@121.244.87.118) Quit ()
[8:51] * Hemanth (~hkumar_@121.244.87.118) has joined #ceph
[8:51] * mhuang (~mhuang@119.254.120.72) Quit (Quit: This computer has gone to sleep)
[8:56] <PoRNo-MoRoZ> is that okay to create single-osd pool with single-pg ? :)
[8:56] * krypto (~krypto@106.51.31.163) has joined #ceph
[8:57] * ircuser-1 (~Johnny@158.183-62-69.ftth.swbr.surewest.net) has joined #ceph
[9:00] * c0dice (~toodles@75-128-34-237.static.mtpk.ca.charter.com) has joined #ceph
[9:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[9:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[9:01] * codice (~toodles@75-128-34-237.static.mtpk.ca.charter.com) Quit (Ping timeout: 480 seconds)
[9:04] * penguinRaider (~KiKo@182.18.155.15) Quit (Ping timeout: 480 seconds)
[9:09] * T1w (~jens@node3.survey-it.dk) has joined #ceph
[9:12] * penguinRaider (~KiKo@182.18.155.15) has joined #ceph
[9:13] * mollstam (~Deiz@torrelay4.tomhek.net) has joined #ceph
[9:14] * dgurtner (~dgurtner@178.197.232.251) has joined #ceph
[9:14] * m0zes (~mozes@ns1.beocat.ksu.edu) Quit (Ping timeout: 480 seconds)
[9:15] * dgurtner (~dgurtner@178.197.232.251) Quit ()
[9:15] * dgurtner (~dgurtner@178.197.232.251) has joined #ceph
[9:16] * dugravot61 (~dugravot6@nat-persul-plg.wifi.univ-lorraine.fr) has joined #ceph
[9:16] * kutija (~kutija@89.216.27.139) has joined #ceph
[9:16] * analbeard (~shw@support.memset.com) has joined #ceph
[9:18] * pabluk_ is now known as pabluk
[9:18] * dugravot6 (~dugravot6@dn-infra-04.lionnois.site.univ-lorraine.fr) Quit (Ping timeout: 480 seconds)
[9:18] * m0zes (~mozes@ns1.beocat.ksu.edu) has joined #ceph
[9:26] * penguinRaider (~KiKo@182.18.155.15) Quit (Ping timeout: 480 seconds)
[9:31] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Ping timeout: 480 seconds)
[9:34] * penguinRaider (~KiKo@182.18.155.15) has joined #ceph
[9:35] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:8490:50ec:39e9:deca) has joined #ceph
[9:38] * rendar (~I@host77-178-dynamic.7-87-r.retail.telecomitalia.it) has joined #ceph
[9:38] * natarej_ (~natarej@2001:8003:4885:6500:1af:3d9f:8ac6:2f91) has joined #ceph
[9:39] * bvi (~Bastiaan@185.56.32.1) Quit (Remote host closed the connection)
[9:41] * rotbeard (~redbeard@185.32.80.238) has joined #ceph
[9:43] * mollstam (~Deiz@4MJAAFRSV.tor-irc.dnsbl.oftc.net) Quit ()
[9:43] * Arcturus (~LorenXo@tor-exit.dhalgren.org) has joined #ceph
[9:44] <etienneme> Why doing this? :)
[9:45] <etienneme> And I guess you need at least replication x = x PG
[9:46] * lxo (~aoliva@lxo.user.oftc.net) Quit (Remote host closed the connection)
[9:46] * natarej (~natarej@2001:8003:4885:6500:d804:46ec:50fd:29e3) Quit (Ping timeout: 480 seconds)
[9:47] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[9:47] * kklimonda_ (sid72883@id-72883.tooting.irccloud.com) Quit ()
[9:58] <PoRNo-MoRoZ> size 1
[9:58] <PoRNo-MoRoZ> just for a test
[9:59] <PoRNo-MoRoZ> how much direct access faster than single-osd-single-pg-size-1-setup
[9:59] <PoRNo-MoRoZ> 1-to-1 comparsion
[9:59] * Hemanth (~hkumar_@121.244.87.118) Quit (Ping timeout: 480 seconds)
[9:59] <PoRNo-MoRoZ> for a guys from development
[10:05] * b0e (~aledermue@213.95.25.82) has joined #ceph
[10:08] * jordanP (~jordan@204.13-14-84.ripe.coltfrance.com) has joined #ceph
[10:08] * DanFoster (~Daniel@2a00:1ee0:3:1337:6daf:eb0:d49b:4418) has joined #ceph
[10:10] * natarej__ (~natarej@101.188.54.14) has joined #ceph
[10:12] * Hemanth (~hkumar_@121.244.87.117) has joined #ceph
[10:13] * Arcturus (~LorenXo@06SAAC9YX.tor-irc.dnsbl.oftc.net) Quit ()
[10:14] * nagyz (~textual@apn-5-206-146-211.vodafone.hu) has joined #ceph
[10:17] * fsimonce (~simon@host128-29-dynamic.250-95-r.retail.telecomitalia.it) has joined #ceph
[10:17] * natarej_ (~natarej@2001:8003:4885:6500:1af:3d9f:8ac6:2f91) Quit (Ping timeout: 480 seconds)
[10:18] * karnan (~karnan@121.244.87.117) has joined #ceph
[10:18] * KapiteinKoffie (~colde@h-130-176.a2.corp.bahnhof.no) has joined #ceph
[10:19] * inf_b (~o_O@dot1x-170-217.wlan.uni-giessen.de) Quit (Ping timeout: 480 seconds)
[10:20] * lxo (~aoliva@lxo.user.oftc.net) Quit (Remote host closed the connection)
[10:20] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[10:23] * inf_b (~o_O@dot1x-170-217.wlan.uni-giessen.de) has joined #ceph
[10:24] <s3an2> Anyone had the error 'mon.ceph-mon-1 store is getting too big'
[10:24] * ircuser-1 (~Johnny@158.183-62-69.ftth.swbr.surewest.net) Quit (Quit: because)
[10:26] <badone> s3an2: try compacting it?
[10:27] * IvanJobs (~ivanjobs@103.50.11.146) Quit (Remote host closed the connection)
[10:28] * yatin (~yatin@161.163.44.8) Quit (Remote host closed the connection)
[10:30] <s3an2> badone, I did give that a try, it took a while but did not reclaim any space
[10:30] * dan__ (~Daniel@office.34sp.com) has joined #ceph
[10:30] * IvanJobs (~ivanjobs@103.50.11.146) has joined #ceph
[10:30] <badone> s3an2: what version?
[10:30] <s3an2> ceph version 10.2.1
[10:31] <badone> how big is it?
[10:32] <s3an2> 32278 MB >= 15360 MB
[10:32] * inf_b (~o_O@dot1x-170-217.wlan.uni-giessen.de) Quit (Read error: Connection reset by peer)
[10:32] * inf_b (~o_O@dot1x-170-217.wlan.uni-giessen.de) has joined #ceph
[10:33] <badone> s3an2: how big is the cluster?
[10:33] <s3an2> 465 osds
[10:33] * hemebond (~james@121.98.140.35) has left #ceph
[10:34] <badone> okay. What command did you use to compact the MONs?>
[10:35] <s3an2> I set 'mon compact on start = true' in the mon and stopped/started the mon
[10:36] <badone> s3an2: okay. Have you seen this post? https://www.mail-archive.com/ceph-users@lists.ceph.com/msg15507.html
[10:36] <s3an2> Yea that is where I found the 'mon compact on start = true' option
[10:37] * DanFoster (~Daniel@2a00:1ee0:3:1337:6daf:eb0:d49b:4418) Quit (Ping timeout: 480 seconds)
[10:37] <s3an2> It is a pretty old post back from firefly
[10:38] <badone> s3an2: agreed, but I think the strategy is still sound. I'd suggest an email to the list hitting the highlights of what we discussed and perhaps the output of the kvstore tool
[10:38] <badone> s3an2: does the size vary at all?
[10:39] <s3an2> It seems to be increasing at a stead rate
[10:39] <s3an2> *steady
[10:39] <vikhyat> babilen: s3an2 may be check the size of du -sh /var/lib/ceph/mon/<mon-name>/store.db/LOG
[10:40] <vikhyat> babilen: unping
[10:40] <vikhyat> badone: ^^ s3an2
[10:40] <badone> vikhyat: hey mate, thanks for jumping in
[10:40] <vikhyat> babilen: s3an2 can you give a try to 'ceph tell mon.FOO compact'
[10:41] * Hemanth (~hkumar_@121.244.87.117) Quit (Quit: Leaving)
[10:41] <vikhyat> in place of restarting
[10:41] <badone> vikhyat: you've seen a few of these lately huh? This is is 10.2.1 though so latest jewel
[10:41] <vikhyat> right
[10:41] <vikhyat> it should not be the issue
[10:41] * Hemanth (~hkumar_@121.244.87.117) has joined #ceph
[10:41] <badone> the ones you would have seen would have been on hammer and firefly right?
[10:42] <vikhyat> right
[10:42] <vikhyat> s3an2: du -sh /var/lib/ceph/mon/<mon-name>/store.db/LOG what is the output of this command
[10:42] <s3an2> -rw-r--r-- 1 ceph ceph 514K May 30 11:51 /var/lib/ceph/mon/ceph-ceph-mon-3/store.db/LOG
[10:42] <badone> so if that doesn't help then a post to the ML would be a good idea so we can get some MON expert eyes on this
[10:43] <vikhyat> s3an2: log size is also not big
[10:43] <s3an2> It looks like the log has not been written into for almost a day
[10:43] <vikhyat> badone: right
[10:44] <vikhyat> s3an2: better give a try with command
[10:44] <vikhyat> 'ceph tell mon.FOO compact'
[10:44] <vikhyat> if still it wont work use montool
[10:45] <vikhyat> but if 'ceph tell mon.FOO compact' and 'mon compact on start = true' option is not working we need a tracker
[10:45] <vikhyat> s3an2: can you please give a try for 'ceph tell mon.FOO compact'
[10:45] <vikhyat> and let us know the results
[10:45] * nagyz (~textual@apn-5-206-146-211.vodafone.hu) Quit (Ping timeout: 480 seconds)
[10:48] * KapiteinKoffie (~colde@4MJAAFRVF.tor-irc.dnsbl.oftc.net) Quit ()
[10:48] * mog_2 (~skrblr@4MJAAFRWG.tor-irc.dnsbl.oftc.net) has joined #ceph
[10:51] * HappyLoaf (~HappyLoaf@cpc93928-bolt16-2-0-cust133.10-3.cable.virginm.net) has joined #ceph
[10:52] * bara (~bara@213.175.37.12) has joined #ceph
[10:55] * yatin (~yatin@161.163.44.8) has joined #ceph
[10:56] * shylesh__ (~shylesh@121.244.87.118) has joined #ceph
[10:57] * m0zes (~mozes@ns1.beocat.ksu.edu) Quit (Ping timeout: 480 seconds)
[10:59] * jordanP (~jordan@204.13-14-84.ripe.coltfrance.com) Quit (Quit: Leaving)
[11:01] * onyb (~ani07nov@112.133.232.12) Quit (Quit: raise SystemExit())
[11:02] * bara (~bara@213.175.37.12) Quit (Ping timeout: 480 seconds)
[11:03] * m0zes (~mozes@ns1.beocat.ksu.edu) has joined #ceph
[11:08] * Kioob1 (~Kioob@ALyon-652-1-152-213.w90-15.abo.wanadoo.fr) has joined #ceph
[11:10] * bara (~bara@nat-pool-brq-t.redhat.com) has joined #ceph
[11:11] * nisha (~nisha@14.139.251.107) has joined #ceph
[11:13] * sickolog1 (~mio@vpn.bcs.hr) has joined #ceph
[11:14] <s3an2> # ceph tell mon.ceph-mon-3 compac still running at the moment
[11:14] <vikhyat> s3an2: yes may be it is doing his job
[11:15] <s3an2> I can see the disk (local ssd on mon) is running at 100%, I will let you know what it looks like once it is done.
[11:15] <vikhyat> s3an2: du -sh /var/lib/ceph/mon/ceph-ceph-mon-3/store.db should be reduced
[11:16] <vikhyat> ack
[11:18] <s3an2> 25G /var/lib/ceph/mon/ceph-ceph-mon-3/store.db
[11:18] * mog_2 (~skrblr@4MJAAFRWG.tor-irc.dnsbl.oftc.net) Quit ()
[11:18] * Silentkillzr1 (~ricin@cloud.tor.ninja) has joined #ceph
[11:18] <vikhyat> earlier it was 31G
[11:18] <vikhyat> so it came down
[11:18] <vikhyat> 32278 MB >= 15360 MB
[11:18] <s3an2> 23G /var/lib/ceph/mon/ceph-ceph-mon-3/store.db
[11:18] <vikhyat> yes it is working
[11:18] <s3an2> it looks to be going in the correct direction
[11:19] <vikhyat> right
[11:19] <vikhyat> is it your cluster was under recovery
[11:19] * nisha (~nisha@14.139.251.107) Quit (Quit: Leaving)
[11:19] <s3an2> yes it is doing recovery
[11:19] <vikhyat> backfill and recovery was running ? when you restarted the mons ?
[11:20] <vikhyat> I set 'mon compact on start = true'
[11:20] <vikhyat> where you set in ceph.conf correct
[11:20] <s3an2> yes
[11:20] * sickology (~mio@vpn.bcs.hr) Quit (Ping timeout: 480 seconds)
[11:21] <vikhyat> so am i right your cluster was doing backfill and recovery when you restarted the mon
[11:21] <vikhyat> and it did not compact the mon db
[11:21] <s3an2> correct
[11:21] <vikhyat> and now still backfill and recovery running ?
[11:21] <s3an2> yes
[11:21] <vikhyat> okay and 'ceph tell mon.FOO compact' is helping
[11:22] <vikhyat> hmm looks like we have some issue
[11:22] <s3an2> looks to be, let me check again now
[11:22] <s3an2> 25G /var/lib/ceph/mon/ceph-ceph-mon-3/store.db
[11:22] <s3an2> seems to be going up now
[11:23] * ram (~oftc-webi@static-202-65-140-146.pol.net.in) has joined #ceph
[11:23] <vikhyat> hmm this is because you have backfill and recovery running
[11:23] <vikhyat> so as osdmaps are changing
[11:24] * epicguy (~epicguy@41.164.8.42) has joined #ceph
[11:27] <ram> Hi folks
[11:28] <s3an2> vikhyat, So you think it maybe best to finish recovery / backfill and then try the compact again?
[11:28] * ircuser-1 (~Johnny@158.183-62-69.ftth.swbr.surewest.net) has joined #ceph
[11:28] <vikhyat> s3an2: right and if you really want to compact as you think it can fill the disk
[11:28] <ram> I set 3 node Ceph cluster. But it was giving health HEALTH_WARN 174 pgs degraded; 192 pgs stuck unclean
[11:28] <vikhyat> s3an2: we need to use the ceph-monstore-tool
[11:29] <vikhyat> s3an2: install ceph-test package
[11:29] <s3an2> vikhyat, OK - We have 500GB of disk space so should be OK for a while - I will push backfill and recovery ops up to get it finished quicker
[11:29] <vikhyat> s3an2: ack
[11:30] <vikhyat> s3an2: stop the mon which you want to compact
[11:30] <vikhyat> ceph-monstore-tool --mon-store-path /var/lib/ceph/mon/<mon name> compact
[11:30] <vikhyat> and start the mon
[11:30] <ram> How to resolve the health issue?
[11:31] <vikhyat> ceph health detail in pastebin
[11:34] * epicguy (~epicguy@41.164.8.42) Quit (Quit: Leaving)
[11:34] * zhaochao_ (~zhaochao@124.202.191.132) has joined #ceph
[11:34] * rdas (~rdas@121.244.87.116) Quit (Quit: Leaving)
[11:34] * rakeshgm (~rakesh@121.244.87.117) has joined #ceph
[11:36] * tserong (~tserong@203-214-92-220.dyn.iinet.net.au) Quit (Remote host closed the connection)
[11:37] * tserong (~tserong@203-214-92-220.dyn.iinet.net.au) has joined #ceph
[11:38] * wjw-freebsd (~wjw@smtp.digiware.nl) Quit (Ping timeout: 480 seconds)
[11:39] * ngoswami (~ngoswami@121.244.87.116) has joined #ceph
[11:39] * bara (~bara@nat-pool-brq-t.redhat.com) Quit (Read error: Connection reset by peer)
[11:39] * bara (~bara@nat-pool-brq-t.redhat.com) has joined #ceph
[11:40] * zhaochao (~zhaochao@125.39.9.148) Quit (Ping timeout: 480 seconds)
[11:40] * zhaochao_ is now known as zhaochao
[11:48] <Walex> ram: http://docs.ceph.com/docs/jewel/rados/troubleshooting/troubleshooting-pg/
[11:48] * Silentkillzr1 (~ricin@7V7AAFHN5.tor-irc.dnsbl.oftc.net) Quit ()
[11:48] * elt (~TomyLobo@d01.brandonann.in) has joined #ceph
[11:50] * dugravot61 (~dugravot6@nat-persul-plg.wifi.univ-lorraine.fr) Quit (Ping timeout: 480 seconds)
[11:50] * neurodrone_ (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) has joined #ceph
[11:52] * dugravot6 (~dugravot6@dn-infra-04.lionnois.site.univ-lorraine.fr) has joined #ceph
[11:55] * dugravot6 (~dugravot6@dn-infra-04.lionnois.site.univ-lorraine.fr) Quit (Remote host closed the connection)
[11:56] * dugravot6 (~dugravot6@dn-infra-04.lionnois.site.univ-lorraine.fr) has joined #ceph
[11:57] <matejz> hey guys??? I have a few questions regarding ceph???
[11:57] * TMM (~hp@178-84-46-106.dynamic.upc.nl) Quit (Quit: Ex-Chat)
[11:57] * realitysandwich (~perry@213.61.152.126) has joined #ceph
[11:58] <matejz> if one of my OSD shutsdown and clusters starts to rebalanca, then in the middle of the process, the old OSD comes back online, what happens?
[11:58] <matejz> does the rebalance finish or does it stop and use data from the old one?
[12:01] * nardial (~ls@dslb-088-075-196-060.088.075.pools.vodafone-ip.de) has joined #ceph
[12:02] * neurodrone_ (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) Quit (Quit: neurodrone_)
[12:02] * fabioFVZ (~fabiofvz@mail.starsoftware.it) has joined #ceph
[12:02] <ram> walex : Thank you.
[12:02] * fabioFVZ (~fabiofvz@mail.starsoftware.it) Quit ()
[12:03] <realitysandwich> matejz: I am having the exact opposite thing right now, I mark an osd as in, data rebalances half way and then goes back
[12:05] <matejz> hum
[12:06] <matejz> cant help you, I???m still in the process of architecturing:)
[12:06] <realitysandwich> haha, me too :P
[12:06] <matejz> also.. is it possble to mark a node as down and stop the cluster from rebalancing
[12:07] <realitysandwich> anyone going to this ceph workshop at the cern center?
[12:07] <matejz> ex: if I need to change a ram stick
[12:07] <matejz> not me??? I hope to go to GridKA meeting
[12:08] <realitysandwich> ah, hadn't seen this one, and not too far from me
[12:12] * elt (~TomyLobo@4MJAAFRYP.tor-irc.dnsbl.oftc.net) Quit (Remote host closed the connection)
[12:13] * JamesHarrison (~Swompie`@185.17.144.138) has joined #ceph
[12:13] * lxo (~aoliva@lxo.user.oftc.net) Quit (Remote host closed the connection)
[12:19] * krypto (~krypto@106.51.31.163) Quit (Quit: Leaving)
[12:32] * EinstCrazy (~EinstCraz@58.247.119.250) Quit (Remote host closed the connection)
[12:34] <Lokta> @matejz from the few tests i did the cluster rebalances itself and when the osd is back online, the content that was balanced comes back to its original place, along with the possible updates
[12:34] * m0zes (~mozes@ns1.beocat.ksu.edu) Quit (Ping timeout: 480 seconds)
[12:35] <Lokta> @matejz so if you know the osd is going back up again soon , set the noout to true so you avoid the rebalancing
[12:35] <matejz> thanks
[12:35] <Lokta> @matejz it also mean that for a while, you will have one less copy
[12:35] <matejz> just got the same info through another channel
[12:35] <Lokta> perfect :)
[12:35] <matejz> hum
[12:36] <matejz> to be "safe", I would like to run with 3 copies in production
[12:36] <matejz> is there an alternative to 2 copies?
[12:36] <matejz> 2=3
[12:36] <matejz> so I wouldn???t need to throw away that much space?
[12:37] <Lokta> erasure coding maybe ?
[12:37] <Lokta> brb, looking at the doc
[12:37] * evelu (~erwan@46.231.131.178) has joined #ceph
[12:37] <Lokta> indeed
[12:37] <Lokta> http://docs.ceph.com/docs/master/rados/operations/erasure-code/
[12:38] <Lokta> works like raid 5
[12:39] * inf_b (~o_O@dot1x-170-217.wlan.uni-giessen.de) Quit (Ping timeout: 480 seconds)
[12:42] * TMM (~hp@185.5.121.201) has joined #ceph
[12:42] * shyu (~shyu@218.241.172.114) Quit (Ping timeout: 480 seconds)
[12:42] * JamesHarrison (~Swompie`@4MJAAFRZH.tor-irc.dnsbl.oftc.net) Quit ()
[12:43] * Thononain (~Tenk@06SAAC96J.tor-irc.dnsbl.oftc.net) has joined #ceph
[12:45] * yatin (~yatin@161.163.44.8) Quit (Remote host closed the connection)
[12:45] * m0zes (~mozes@ns1.beocat.ksu.edu) has joined #ceph
[12:46] * kefu is now known as kefu|afk
[12:46] * karnan (~karnan@121.244.87.117) Quit (Ping timeout: 480 seconds)
[12:48] * huangjun|2 (~kvirc@113.57.168.154) Quit (Ping timeout: 480 seconds)
[12:54] * vikhyat is now known as vikhyat|brb
[12:55] * slotec (~IRFAG@184.75.221.171) has joined #ceph
[13:00] * neurodrone_ (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) has joined #ceph
[13:03] * inf_b (~o_O@dot1x-170-217.wlan.uni-giessen.de) has joined #ceph
[13:04] * vicente (~~vicente@125-227-238-55.HINET-IP.hinet.net) Quit (Quit: Leaving)
[13:05] * yatin (~yatin@161.163.44.8) has joined #ceph
[13:08] * johnavp1989 (~jpetrini@pool-100-14-10-2.phlapa.fios.verizon.net) has joined #ceph
[13:08] <- *johnavp1989* To prove that you are human, please enter the result of 8+3
[13:12] * dougf (~dougf@96-38-99-179.dhcp.jcsn.tn.charter.com) Quit (Ping timeout: 480 seconds)
[13:12] * Thononain (~Tenk@06SAAC96J.tor-irc.dnsbl.oftc.net) Quit ()
[13:14] * slotec (~IRFAG@184.75.221.171) Quit (Ping timeout: 480 seconds)
[13:14] * dougf (~dougf@96-38-99-179.dhcp.jcsn.tn.charter.com) has joined #ceph
[13:16] * rraja (~rraja@121.244.87.117) has joined #ceph
[13:17] * inf_b (~o_O@dot1x-170-217.wlan.uni-giessen.de) Quit (Ping timeout: 480 seconds)
[13:24] * IvanJobs (~ivanjobs@103.50.11.146) Quit (Remote host closed the connection)
[13:25] * inf_b (~o_O@dot1x-170-217.wlan.uni-giessen.de) has joined #ceph
[13:25] * IvanJobs (~ivanjobs@103.50.11.146) has joined #ceph
[13:27] * neurodrone_ (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) Quit (Quit: neurodrone_)
[13:28] * vikhyat|brb is now known as vikhyat
[13:30] * AscII (~marks@perseus.mschade.de) has joined #ceph
[13:31] * nardial (~ls@dslb-088-075-196-060.088.075.pools.vodafone-ip.de) Quit (Ping timeout: 480 seconds)
[13:35] * yatin (~yatin@161.163.44.8) Quit (Remote host closed the connection)
[13:36] * flisky (~Thunderbi@36.110.40.22) has joined #ceph
[13:41] * bara (~bara@nat-pool-brq-t.redhat.com) Quit (Quit: Bye guys! (??????????????????? ?????????)
[13:43] * dotblank (~ahmeni@185.8.63.16) has joined #ceph
[13:45] * nardial (~ls@dslb-088-075-196-060.088.075.pools.vodafone-ip.de) has joined #ceph
[13:45] * rdas (~rdas@121.244.87.116) has joined #ceph
[13:48] * prallab (~prallab@216.207.42.137) Quit (Remote host closed the connection)
[13:48] * neurodrone_ (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) has joined #ceph
[13:49] * ira (~ira@c-24-34-255-34.hsd1.ma.comcast.net) has joined #ceph
[13:50] * prallab (~prallab@216.207.42.137) has joined #ceph
[13:51] * Miouge_ (~Miouge@188.189.72.194) has joined #ceph
[13:51] * IvanJobs (~ivanjobs@103.50.11.146) Quit (Remote host closed the connection)
[13:52] * Miouge (~Miouge@188.189.75.139) Quit (Ping timeout: 480 seconds)
[13:52] * Miouge_ is now known as Miouge
[13:52] * bene (~bene@2601:18c:8501:41d0:ea2a:eaff:fe08:3c7a) has joined #ceph
[13:52] * dgurtner (~dgurtner@178.197.232.251) Quit (Read error: No route to host)
[13:53] * prallab_ (~prallab@216.207.42.137) has joined #ceph
[13:53] * bara (~bara@213.175.37.12) has joined #ceph
[13:54] * shyu (~shyu@218.241.172.114) has joined #ceph
[13:56] * jole (~oftc-webi@ip-176-52-204-227.static.reverse.dsi.net) has joined #ceph
[13:56] * slotec (~IRFAG@184.75.221.171) has joined #ceph
[13:58] * prallab (~prallab@216.207.42.137) Quit (Ping timeout: 480 seconds)
[13:58] * valeech (~valeech@pool-108-44-162-111.clppva.fios.verizon.net) has joined #ceph
[13:58] * ira (~ira@c-24-34-255-34.hsd1.ma.comcast.net) Quit (Ping timeout: 480 seconds)
[13:58] * IvanJobs (~ivanjobs@103.50.11.146) has joined #ceph
[13:59] * wjw-freebsd (~wjw@176.74.240.1) has joined #ceph
[14:01] <jole> Hello there! After a lot of Googling, I still can't find a solution for my problem. I have a 4 node cluster, with 72 OSDs, 3 MONs and one MDS. I had to run "ceph osd reweight-by-utilization" and when this process finished - my cluster went to HEALTH_WARN. It shows that there are "5 pgs stuck unclean". Recovery process is stopped, while there are still 0,1% objects misplaced. Does anyone have any idea what could I do about this?
[14:01] * prallab_ (~prallab@216.207.42.137) Quit (Ping timeout: 480 seconds)
[14:02] <jole> Restarting OSDs where the problematic PGs are didn't help, neither taking them "out" from cluster.
[14:03] * IRFAG_ (~IRFAG@103.29.31.61) has joined #ceph
[14:04] * slotec (~IRFAG@184.75.221.171) Quit (Ping timeout: 480 seconds)
[14:05] * bniver (~bniver@nat-pool-bos-u.redhat.com) has joined #ceph
[14:12] * dotblank (~ahmeni@4MJAAFR20.tor-irc.dnsbl.oftc.net) Quit ()
[14:12] * CydeWeys (~andrew_m@edwardsnowden2.torservers.net) has joined #ceph
[14:13] * shyu (~shyu@218.241.172.114) Quit (Ping timeout: 480 seconds)
[14:14] * IRFAG_ (~IRFAG@103.29.31.61) Quit (Ping timeout: 480 seconds)
[14:15] * IvanJobs (~ivanjobs@103.50.11.146) Quit ()
[14:15] <ram> Hi. I am configuring radosgw for Ceph storage cluster. radosgw service is not starting.
[14:15] <ram> No /usr/bin/radosgw found running; none killed. /usr/bin/radosgw is not running.
[14:17] <ram> It was giving the issue as shown above
[14:17] * DV (~veillard@2001:41d0:a:f29f::1) has joined #ceph
[14:20] <vikhyat> ram: did you install ceph-radosgw package
[14:21] <vikhyat> and have it configured
[14:21] <vikhyat> with ceph-deploy rgw create
[14:21] * shyu (~shyu@218.241.172.114) has joined #ceph
[14:21] * mattbenjamin1 (~mbenjamin@12.118.3.106) has joined #ceph
[14:21] <vikhyat> which version you are using
[14:21] <vikhyat> ceph -v
[14:23] * wes_dillingham (~wes_dilli@140.247.242.44) has joined #ceph
[14:28] <Kruge> ram: I had this problem myself not too long ago. Make sure that you have created a directory at /var/lib/ceph/radosgw/ceph-<your rgw name>
[14:29] * Kurt (~Adium@2001:628:1:5:7d9d:babe:b49:c61e) has joined #ceph
[14:30] <Kruge> And I seem to recall that I had to put a "sysvinit" file in there, too, or else the init script failed to start the radosgw
[14:30] <Kruge> This is on hammer, btw
[14:32] * dneary (~dneary@nat-pool-bos-u.redhat.com) has joined #ceph
[14:33] <Kruge> Could someone tell me where the most appropriate place to make a feature request would be, please?
[14:42] * CydeWeys (~andrew_m@7V7AAFHVD.tor-irc.dnsbl.oftc.net) Quit ()
[14:42] * QuantumBeep1 (~Bored@4MJAAFR5Q.tor-irc.dnsbl.oftc.net) has joined #ceph
[14:45] <ram> vikhyat : Hi. I followed the link http://devcenter.megam.io/2015/10/13/ceph-gateway/ to configure radosgw
[14:46] <vikhyat> Kruge: for which component
[14:46] <vikhyat> in ceph
[14:46] <vikhyat> or it is core RADOS
[14:46] * bene (~bene@2601:18c:8501:41d0:ea2a:eaff:fe08:3c7a) Quit (Quit: Konversation terminated!)
[14:47] <ram> vikhyat: I am using ceph version 0.80.11
[14:47] <vikhyat> ram: looks me very old please use civetweb
[14:47] <vikhyat> http://docs.ceph.com/docs/master/install/install-ceph-gateway/
[14:48] <ram> vikhyat: Thank you. I will use civetweb now
[14:49] <vikhyat> Kruge: if it is core rados : http://tracker.ceph.com/projects/ceph/issues/new select Feature in Tracker field
[14:49] * johnavp1989 (~jpetrini@pool-100-14-10-2.phlapa.fios.verizon.net) Quit (Ping timeout: 480 seconds)
[14:49] * user_8474 (779f7a07@107.161.19.109) has joined #ceph
[14:49] <user_8474> Allah is doing
[14:50] <user_8474> sun is not doing Allah is doing
[14:50] <user_8474> moon is not doing Allah is doing
[14:50] <ram> kruge : Hi. Thank you.
[14:50] <user_8474> stars are not doing Allah is doing
[14:50] <user_8474> planets are not doing Allah is doing
[14:50] <user_8474> galaxies are not doing Allah is doing
[14:50] <user_8474> oceans are not doing Allah is doing
[14:51] <user_8474> mountains are not doing Allah is doing
[14:51] <user_8474> trees are not doing Allah is doing
[14:51] <user_8474> mom is not doing Allah is doing
[14:51] <user_8474> dad is not doing Allah is doing
[14:51] <user_8474> boss is not doing Allah is doing
[14:51] <user_8474> job is not doing Allah is doing
[14:51] <user_8474> dollar is not doing Allah is doing
[14:54] <user_8474> degree is not doing Allah is doing
[14:54] <user_8474> medicine is not doing Allah is doing
[14:54] <user_8474> customers are not doing Allah is doing
[14:54] * georgem (~Adium@104-222-119-175.cpe.teksavvy.com) has joined #ceph
[14:56] <user_8474> you can not get a job without the permission of allah
[14:57] <ram> ram: Hi. Please tell me a detailed reference link for integrating Ceph with keystone.
[14:58] * evelu (~erwan@46.231.131.178) Quit (Ping timeout: 480 seconds)
[14:59] * Hemanth (~hkumar_@121.244.87.117) Quit (Ping timeout: 480 seconds)
[15:00] <user_8474> you can not get married without the permission of allah
[15:01] <user_8474> nobody can get angry at you without the permission of allah
[15:02] * pabluk (~pabluk@2a01:e34:ec16:93e0:45a4:60dc:71a7:623b) Quit (Ping timeout: 480 seconds)
[15:02] <user_8474> light is not doing Allah is doing
[15:02] <user_8474> fan is not doing Allah is doing
[15:03] * jole (~oftc-webi@ip-176-52-204-227.static.reverse.dsi.net) Quit (Quit: Page closed)
[15:03] * newbie (~kvirc@host217-114-156-249.pppoe.mark-itt.net) has joined #ceph
[15:03] * rdas (~rdas@121.244.87.116) Quit (Quit: Leaving)
[15:03] * rraja (~rraja@121.244.87.117) Quit (Ping timeout: 480 seconds)
[15:04] <user_8474> businessess are not doing Allah is doing
[15:04] * dgurtner (~dgurtner@178.197.232.251) has joined #ceph
[15:05] <user_8474> america is not doing Allah is doing
[15:06] * pabluk (~pabluk@2a01:e34:ec16:93e0:743e:8d02:87a6:69ac) has joined #ceph
[15:06] <user_8474> fire can not burn without the permission of allah
[15:07] * scg (~zscg@valis.gnu.org) has joined #ceph
[15:07] <Heebie> Can someone kb or kline user_8474 ?
[15:08] <user_8474> knife can not cut without the permission of allah
[15:11] <user_8474> rulers are not doing Allah is doing
[15:11] <Kruge> vikhyat: Sorry, was afk. It's a feature request for radosgw, specifically support for AWS4 authentication header hashing.
[15:12] * billwebb (~billwebb@50-203-47-138-static.hfc.comcastbusiness.net) has joined #ceph
[15:12] * QuantumBeep1 (~Bored@4MJAAFR5Q.tor-irc.dnsbl.oftc.net) Quit ()
[15:13] <user_8474> governments are not doing Allah is doing
[15:13] * Roy (~bildramer@192.87.28.28) has joined #ceph
[15:13] <vikhyat> Kruge: http://tracker.ceph.com/projects/rgw/issues/new select Feature in Tracker field
[15:14] * billwebb (~billwebb@50-203-47-138-static.hfc.comcastbusiness.net) Quit (Read error: Connection reset by peer)
[15:14] * rraja (~rraja@121.244.87.117) has joined #ceph
[15:15] <user_8474> sleep is not doing Allah is doing
[15:15] <user_8474> hunger is not doing Allah is doing
[15:15] <Kruge> vikhyat: Thanks
[15:16] * pdrakeweb (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) has joined #ceph
[15:16] <realitysandwich> I think I can just give up on life and let allah take care of everything
[15:19] <Heebie> realitysandwich: God is great... great enough that he doesn't need trolls in IRC channels. :)
[15:20] * rossdylan (~rossdylan@2605:6400:1:fed5:22:68c4:af80:cb6e) has joined #ceph
[15:20] <BranchPredictor> I reported that thing on #oftc, dunno if they're going to act
[15:21] * mhack (~mhack@nat-pool-bos-t.redhat.com) has joined #ceph
[15:25] <user_8474> food does not take away the hunger Allah takes away the hunger
[15:25] * newbie46 (~kvirc@host217-114-156-249.pppoe.mark-itt.net) has joined #ceph
[15:26] * newbie (~kvirc@host217-114-156-249.pppoe.mark-itt.net) Quit (Read error: Connection reset by peer)
[15:26] * musca (musca@tyrael.eu) has joined #ceph
[15:29] <user_8474> water does not take away the thirst Allah takes away the thirst
[15:30] <user_8474> seeing is not doing Allah is doing
[15:32] <user_8474> hearing is not doing Allah is doing
[15:33] <devicenull> does ceph not do automatic compaction of osds?
[15:33] * valeech (~valeech@pool-108-44-162-111.clppva.fios.verizon.net) Quit (Quit: valeech)
[15:33] <devicenull> er, mons
[15:33] <devicenull> I keep hitting 'mon.x store is getting too big! 16978 MB >= 15360 MB'
[15:33] <devicenull> but 'ceph tell mon.* compact' resolves it
[15:34] <user_8474> seasons are not doing Allah is doing
[15:34] <user_8474> weather is not doing Allah is doing
[15:34] * opal (h@eat.at.the.krustykrab.restaurant) has joined #ceph
[15:35] <BranchPredictor> zomg... 153635 < {> ??? BranchPredictor you should pray to ALLAH to assist you ???
[15:35] <opal> ??? BranchPredictor it's ironic you complain about bots when a bot tries to message me on join here ???
[15:35] <opal> ??? 13 34 45 - CephLogBot[~PircBot@rockbox.widodh.nl] :is messaging you, and you are umode +g or +G. ???
[15:35] * zhaochao (~zhaochao@124.202.191.132) Quit (Quit: ChatZilla 0.9.92 [Firefox 45.1.1/20160507231935])
[15:35] * Ganneff (~joerg@ganneff.noc.oftc.net) has joined #ceph
[15:36] * kefu|afk (~kefu@114.92.122.74) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[15:36] <BranchPredictor> opal: this is a logging bot.
[15:36] <opal> ??? public logging? ???
[15:36] <BranchPredictor> no idea
[15:36] * johnavp1989 (~jpetrini@8.39.115.8) has joined #ceph
[15:36] <- *johnavp1989* To prove that you are human, please enter the result of 8+3
[15:37] * kefu (~kefu@183.193.182.2) has joined #ceph
[15:37] <BranchPredictor> anyway, it's messaging everyone who joins to notify that channel is logged.
[15:37] * ira (~ira@c-24-34-255-34.hsd1.ma.comcast.net) has joined #ceph
[15:37] * shyu (~shyu@218.241.172.114) Quit (Ping timeout: 480 seconds)
[15:38] * Ganneff (~joerg@ganneff.noc.oftc.net) has left #ceph
[15:38] * Ganneff (~joerg@ganneff.noc.oftc.net) has joined #ceph
[15:38] * huangjun (~kvirc@117.151.50.232) has joined #ceph
[15:39] <- *opal* hello
[15:39] <- *opal* help
[15:39] [opal VERSION]
[15:39] <opal> ??? it's not very verbose otherwise ???
[15:40] <opal> ??? anyway i dont want to be in a channel that may be public logging ???
[15:40] * opal (h@eat.at.the.krustykrab.restaurant) has left #ceph
[15:40] <devicenull> why are all your messages different colors?
[15:40] <devicenull> that's even more annoying then the logging
[15:41] * Kioob1 (~Kioob@ALyon-652-1-152-213.w90-15.abo.wanadoo.fr) Quit (Quit: Leaving.)
[15:42] <user_8474> humans are not doing Allah is doing
[15:42] <BranchPredictor> ...
[15:42] * user_8474 (779f7a07@107.161.19.109) Quit (autokilled: This host violated network policy. If you feel an error has been made, please contact support@oftc.net, thanks. (2016-05-31 09:42:28))
[15:42] <BranchPredictor> oh.
[15:42] * Roy (~bildramer@06SAADADG.tor-irc.dnsbl.oftc.net) Quit ()
[15:42] * slowriot (~Bobby@06SAADAGA.tor-irc.dnsbl.oftc.net) has joined #ceph
[15:45] * Kioob1 (~Kioob@ALyon-652-1-152-213.w90-15.abo.wanadoo.fr) has joined #ceph
[15:47] * overclk (~quassel@121.244.87.117) Quit (Remote host closed the connection)
[15:48] * flisky (~Thunderbi@246e2816.test.dnsbl.oftc.net) Quit (Ping timeout: 480 seconds)
[15:55] * aboyle (~aboyle__@ardent.csail.mit.edu) Quit (Remote host closed the connection)
[15:57] * kefu_ (~kefu@li1072-18.members.linode.com) has joined #ceph
[15:57] * ircolle (~Adium@173-219-119-98.com.sta.suddenlink.net) has joined #ceph
[15:57] * ircolle (~Adium@173-219-119-98.com.sta.suddenlink.net) Quit ()
[16:01] * matejz (~matejz@141.255.254.208) Quit (Quit: matejz)
[16:01] * kefu (~kefu@183.193.182.2) Quit (Ping timeout: 480 seconds)
[16:03] * khyron (~khyron@fixed-190-159-187-190-159-75.iusacell.net) Quit (Quit: The computer fell asleep)
[16:03] * sudocat (~dibarra@192.185.1.20) has joined #ceph
[16:05] * xarses (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[16:06] * dgurtner (~dgurtner@178.197.232.251) Quit (Quit: Reconnecting)
[16:07] * dgurtner (~dgurtner@178.197.232.251) has joined #ceph
[16:09] * m0zes (~mozes@ns1.beocat.ksu.edu) Quit (Ping timeout: 480 seconds)
[16:09] * MrHeavy (~MrHeavy@pool-108-29-34-55.nycmny.fios.verizon.net) has joined #ceph
[16:11] * yanzheng (~zhyan@118.116.112.223) Quit (Quit: ??????)
[16:12] * gauravbafna (~gauravbaf@49.32.0.40) Quit (Remote host closed the connection)
[16:12] * squizzi (~squizzi@107.13.31.195) has joined #ceph
[16:12] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[16:12] * slowriot (~Bobby@06SAADAGA.tor-irc.dnsbl.oftc.net) Quit ()
[16:13] * m0zes (~mozes@ns1.beocat.ksu.edu) has joined #ceph
[16:13] * elt (~Xerati@exit1.torproxy.org) has joined #ceph
[16:15] * Ganneff (~joerg@ganneff.noc.oftc.net) has left #ceph
[16:16] * karnan (~karnan@103.227.97.69) has joined #ceph
[16:18] * karnan (~karnan@103.227.97.69) Quit (Remote host closed the connection)
[16:18] * gauravbafna (~gauravbaf@49.32.0.40) has joined #ceph
[16:18] * nardial (~ls@dslb-088-075-196-060.088.075.pools.vodafone-ip.de) Quit (Quit: Leaving)
[16:18] * vikhyat (~vumrao@121.244.87.116) Quit (Quit: Leaving)
[16:19] * EinstCrazy (~EinstCraz@116.224.225.85) has joined #ceph
[16:24] * gregmark (~Adium@68.87.42.115) has joined #ceph
[16:25] * jrankin (~jrankin@d53-64-170-236.nap.wideopenwest.com) has joined #ceph
[16:26] * gauravbafna (~gauravbaf@49.32.0.40) Quit (Ping timeout: 480 seconds)
[16:30] * cathode (~cathode@50.232.215.114) has joined #ceph
[16:33] * jrankin (~jrankin@d53-64-170-236.nap.wideopenwest.com) Quit (Quit: Leaving)
[16:33] * huangjun (~kvirc@117.151.50.232) Quit (Ping timeout: 480 seconds)
[16:33] * bene (~bene@nat-pool-bos-t.redhat.com) has joined #ceph
[16:34] * debian112 (~bcolbert@24.126.201.64) has joined #ceph
[16:34] * vanham (~vanham@12.199.84.146) Quit (Ping timeout: 480 seconds)
[16:35] * Racpatel (~Racpatel@c-71-201-162-82.hsd1.il.comcast.net) has joined #ceph
[16:36] <Be-El> libceph: corrupt osd_op_reply got 187 187 <-- kernel based ceph client, ubuntu xenial kernel. is it possible to extract some information from the content dump as user, or do I need to open a ticket for this?
[16:37] * T1w (~jens@node3.survey-it.dk) Quit (Ping timeout: 480 seconds)
[16:38] * joshd1 (~jdurgin@71-92-201-212.dhcp.gldl.ca.charter.com) has joined #ceph
[16:41] * MentalRay (~MentalRay@MTRLPQ42-1176054809.sdsl.bell.ca) has joined #ceph
[16:41] * vata (~vata@207.96.182.162) has joined #ceph
[16:42] * elt (~Xerati@4MJAAFSBK.tor-irc.dnsbl.oftc.net) Quit ()
[16:42] * Malcovent (~Jourei@185.29.8.132) has joined #ceph
[16:43] * m0zes (~mozes@ns1.beocat.ksu.edu) Quit (Ping timeout: 480 seconds)
[16:43] * rakeshgm (~rakesh@121.244.87.117) Quit (Remote host closed the connection)
[16:45] * flisky (~Thunderbi@106.37.236.184) has joined #ceph
[16:46] * flisky (~Thunderbi@106.37.236.184) Quit ()
[16:47] * kefu (~kefu@114.92.122.74) has joined #ceph
[16:50] <kiranos> http://www.spinics.net/lists/ceph-users/msg28139.html
[16:50] <kiranos> Be-El: have you seen this?
[16:50] <kiranos> do you know what might cause it
[16:51] * vata (~vata@207.96.182.162) Quit (Remote host closed the connection)
[16:51] * karnan (~karnan@103.227.97.69) has joined #ceph
[16:52] * kefu_ (~kefu@li1072-18.members.linode.com) Quit (Ping timeout: 480 seconds)
[16:53] * davidzlap (~Adium@2605:e000:1313:8003:d469:1103:69a8:38de) has joined #ceph
[16:54] <Be-El> kiranos: sorry, no clue. i haven't worked with jewel yet
[16:54] <Be-El> kiranos: but you can try to reproduce the problem with the ceph-disk prepare call. it should created the symlink afaik
[16:55] * m0zes (~mozes@ns1.beocat.ksu.edu) has joined #ceph
[16:56] * xarses (~xarses@64.124.158.100) has joined #ceph
[16:56] * inf_b (~o_O@dot1x-170-217.wlan.uni-giessen.de) Quit (Remote host closed the connection)
[16:57] * shylesh__ (~shylesh@121.244.87.118) Quit (Remote host closed the connection)
[17:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[17:01] * kutija (~kutija@89.216.27.139) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[17:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[17:04] * antongribok (~antongrib@216.207.42.140) has joined #ceph
[17:06] * wushudoin (~wushudoin@2601:646:9501:d2b2:2ab2:bdff:fe0b:a6ee) has joined #ceph
[17:07] * aboyle (~aboyle__@2001:470:8b2d:1e1c:d267:e5ff:feec:c62c) has joined #ceph
[17:07] * danieagle (~Daniel@179.110.89.229) Quit (Quit: Obrigado por Tudo! :-) inte+ :-))
[17:08] * wushudoin (~wushudoin@2601:646:9501:d2b2:2ab2:bdff:fe0b:a6ee) Quit ()
[17:08] * rraja (~rraja@121.244.87.117) Quit (Ping timeout: 480 seconds)
[17:11] * TMM (~hp@185.5.121.201) Quit (Quit: Ex-Chat)
[17:11] * jole (~oftc-webi@ip-176-52-204-227.static.reverse.dsi.net) has joined #ceph
[17:11] * jole (~oftc-webi@ip-176-52-204-227.static.reverse.dsi.net) Quit ()
[17:12] * Malcovent (~Jourei@4MJAAFSDE.tor-irc.dnsbl.oftc.net) Quit ()
[17:16] * b0e (~aledermue@213.95.25.82) Quit (Quit: Leaving.)
[17:17] * SinZ|offline (~Sirrush@4MJAAFSE5.tor-irc.dnsbl.oftc.net) has joined #ceph
[17:17] * ade (~abradshaw@dslb-094-222-177-039.094.222.pools.vodafone-ip.de) Quit (Quit: Too sexy for his shirt)
[17:18] * vata (~vata@207.96.182.162) has joined #ceph
[17:18] * wushudoin (~wushudoin@2601:646:9501:d2b2:2ab2:bdff:fe0b:a6ee) has joined #ceph
[17:21] * DV (~veillard@2001:41d0:a:f29f::1) Quit (Ping timeout: 480 seconds)
[17:21] * ntpttr_laptop (~ntpttr@192.55.54.45) has joined #ceph
[17:22] * khyron (~khyron@200.77.224.239) has joined #ceph
[17:22] * overclk (~quassel@117.202.96.108) has joined #ceph
[17:22] * analbeard (~shw@support.memset.com) Quit (Quit: Leaving.)
[17:28] * EinstCrazy (~EinstCraz@116.224.225.85) Quit (Remote host closed the connection)
[17:29] * EinstCrazy (~EinstCraz@116.224.225.85) has joined #ceph
[17:29] * EinstCrazy (~EinstCraz@116.224.225.85) Quit (Remote host closed the connection)
[17:31] * kevinc (~kevinc__@client65-97.sdsc.edu) has joined #ceph
[17:31] * kevinc (~kevinc__@client65-97.sdsc.edu) Quit ()
[17:34] <kiranos> in jewel how do I stop an osd?
[17:34] <kiranos> thttp://docs.ceph.com/docs/jewel/rados/operations/operating/
[17:34] <kiranos> doesnt include systemd
[17:34] <kiranos> which jewel is using
[17:35] <kiranos> there is no init.d/ceph anymore
[17:35] * TomasCZ (~TomasCZ@yes.tenlab.net) has joined #ceph
[17:36] <Be-El> kiranos: you can stop the systemd service
[17:37] <Be-El> and yes, the systemd documentation is somewhat lacking (as is systemd, but i don't want to start a flamewar... )
[17:37] * deepthi (~deepthi@122.171.69.55) Quit (Quit: Leaving)
[17:40] * linuxkidd (~linuxkidd@ip70-189-207-54.lv.lv.cox.net) has joined #ceph
[17:41] <khyron> kiranos: did you try # stop ceph-osd id=X
[17:41] * Be-El (~blinke@nat-router.computational.bio.uni-giessen.de) Quit (Quit: Leaving.)
[17:41] * ntpttr_laptop (~ntpttr@192.55.54.45) Quit (Remote host closed the connection)
[17:41] * ntpttr_laptop (~ntpttr@134.134.139.82) has joined #ceph
[17:42] * kefu (~kefu@114.92.122.74) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[17:43] * kefu (~kefu@183.193.182.2) has joined #ceph
[17:44] * vanham (~vanham@199.59.96.208) has joined #ceph
[17:46] * kefu (~kefu@183.193.182.2) Quit (Max SendQ exceeded)
[17:47] * SinZ|offline (~Sirrush@4MJAAFSE5.tor-irc.dnsbl.oftc.net) Quit ()
[17:47] * TheDoudou_a (~DoDzy@hessel2.torservers.net) has joined #ceph
[17:47] * kefu (~kefu@183.193.182.2) has joined #ceph
[17:50] * kutija (~kutija@89.216.27.139) has joined #ceph
[17:51] * ntpttr_laptop_ (~ntpttr@134.134.139.82) has joined #ceph
[17:51] * ntpttr_laptop (~ntpttr@134.134.139.82) Quit (Remote host closed the connection)
[17:52] * valeech (~valeech@wsip-98-175-102-67.dc.dc.cox.net) has joined #ceph
[17:52] * Miouge (~Miouge@188.189.72.194) Quit (Quit: Miouge)
[17:52] * bara (~bara@213.175.37.12) Quit (Remote host closed the connection)
[17:53] * bara (~bara@213.175.37.12) has joined #ceph
[17:56] * Miouge (~Miouge@188.189.72.194) has joined #ceph
[17:57] * bvi (~Bastiaan@185.56.32.1) has joined #ceph
[17:57] * gregmark (~Adium@68.87.42.115) Quit (Quit: Leaving.)
[18:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[18:01] * haomaiwang (~haomaiwan@106.187.51.170) has joined #ceph
[18:09] * valeech (~valeech@wsip-98-175-102-67.dc.dc.cox.net) Quit (Quit: valeech)
[18:10] * ntpttr_laptop__ (~ntpttr@134.134.139.82) has joined #ceph
[18:10] * ntpttr_laptop_ (~ntpttr@134.134.139.82) Quit (Remote host closed the connection)
[18:11] * Miouge (~Miouge@188.189.72.194) Quit (Quit: Miouge)
[18:11] * valeech (~valeech@wsip-98-175-102-67.dc.dc.cox.net) has joined #ceph
[18:11] * davidzlap (~Adium@2605:e000:1313:8003:d469:1103:69a8:38de) Quit (Quit: Leaving.)
[18:12] * matejz (~matejz@element.planetq.org) has joined #ceph
[18:15] * reed (~reed@75-101-54-18.dsl.static.fusionbroadband.com) has joined #ceph
[18:15] * wjw-freebsd (~wjw@176.74.240.1) Quit (Ping timeout: 480 seconds)
[18:16] * kefu (~kefu@183.193.182.2) Quit (Ping timeout: 480 seconds)
[18:17] * TheDoudou_a (~DoDzy@06SAADANP.tor-irc.dnsbl.oftc.net) Quit ()
[18:17] * MKoR (~w0lfeh@81-7-15-115.blue.kundencontroller.de) has joined #ceph
[18:18] * kefu (~kefu@114.92.122.74) has joined #ceph
[18:19] * pabluk is now known as pabluk_
[18:20] * i_m (~ivan.miro@nat-5-carp.hcn-strela.ru) has joined #ceph
[18:20] * valeech (~valeech@wsip-98-175-102-67.dc.dc.cox.net) Quit (Quit: valeech)
[18:21] * beck (~textual@109.202.107.5) has joined #ceph
[18:21] * beck is now known as abeck
[18:26] * gregmark (~Adium@68.87.42.115) has joined #ceph
[18:27] * evelu (~erwan@2a01:e34:eecb:7400:4eeb:42ff:fedc:8ac) has joined #ceph
[18:31] * realitysandwich (~perry@213.61.152.126) Quit (Ping timeout: 480 seconds)
[18:33] * m0zes (~mozes@ns1.beocat.ksu.edu) Quit (Ping timeout: 480 seconds)
[18:33] * dvanders (~dvanders@dvanders-pro.cern.ch) Quit (Ping timeout: 480 seconds)
[18:34] * kawa2014 (~kawa@89.184.114.246) Quit (Quit: Leaving)
[18:34] * tserong (~tserong@203-214-92-220.dyn.iinet.net.au) Quit (Ping timeout: 480 seconds)
[18:35] * kefu (~kefu@114.92.122.74) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[18:35] * tserong (~tserong@203-214-92-220.dyn.iinet.net.au) has joined #ceph
[18:36] * dgurtner (~dgurtner@178.197.232.251) Quit (Ping timeout: 480 seconds)
[18:38] * TMM (~hp@178-84-46-106.dynamic.upc.nl) has joined #ceph
[18:39] * vanham (~vanham@199.59.96.208) Quit (Ping timeout: 480 seconds)
[18:40] * jcsp (~jspray@82-71-16-249.dsl.in-addr.zen.co.uk) Quit (Ping timeout: 480 seconds)
[18:40] * mykola (~Mikolaj@91.245.76.80) has joined #ceph
[18:44] * joshd1 (~jdurgin@71-92-201-212.dhcp.gldl.ca.charter.com) Quit (Quit: Leaving.)
[18:44] * bvi (~Bastiaan@185.56.32.1) Quit (Ping timeout: 480 seconds)
[18:46] * joelc (~joelc@rrcs-71-41-248-34.sw.biz.rr.com) has joined #ceph
[18:46] * vasu (~vasu@c-73-231-60-138.hsd1.ca.comcast.net) has joined #ceph
[18:47] * MKoR (~w0lfeh@7V7AAFIAM.tor-irc.dnsbl.oftc.net) Quit ()
[18:50] * DV_ (~veillard@2001:41d0:a:f29f::1) has joined #ceph
[18:51] * dan__ (~Daniel@office.34sp.com) Quit (Quit: Leaving)
[18:51] * branto (~branto@ip-78-102-208-181.net.upcbroadband.cz) Quit (Quit: Leaving.)
[18:52] * valeech (~valeech@pool-108-44-162-111.clppva.fios.verizon.net) has joined #ceph
[18:52] * jcsp (~jspray@82-71-16-249.dsl.in-addr.zen.co.uk) has joined #ceph
[18:55] * bara (~bara@213.175.37.12) Quit (Ping timeout: 480 seconds)
[18:57] * shylesh__ (~shylesh@45.124.227.112) has joined #ceph
[18:59] * vanham (~vanham@mia1-puppet.supramail.com.br) has joined #ceph
[19:00] * Kioob1 (~Kioob@ALyon-652-1-152-213.w90-15.abo.wanadoo.fr) Quit (Quit: Leaving.)
[19:01] * haomaiwang (~haomaiwan@106.187.51.170) Quit (Remote host closed the connection)
[19:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[19:02] <kiranos> khyron: stop ceph-osd id=0
[19:02] <kiranos> -bash: stop: command not found
[19:02] <kiranos> this is crazy :P stable LTS and no documentation of how you manage the cluster
[19:03] <kiranos> systemctl stop ceph-osd@0
[19:03] <kiranos> did it
[19:10] <kiranos> khyron: https://github.com/angapov/ceph-systemd
[19:10] <kiranos> there is a list
[19:15] * davidz (~davidz@2605:e000:1313:8003:b580:20cc:bfa0:1c0c) has joined #ceph
[19:15] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[19:15] * owasserm (~owasserm@2001:984:d3f7:1:5ec5:d4ff:fee0:f6dc) Quit (Ping timeout: 480 seconds)
[19:16] * matejz (~matejz@element.planetq.org) Quit (Quit: matejz)
[19:18] * vanham (~vanham@mia1-puppet.supramail.com.br) Quit (Ping timeout: 480 seconds)
[19:20] * overclk (~quassel@117.202.96.108) Quit (Remote host closed the connection)
[19:22] * Kakeru (~colde@159.148.186.194) has joined #ceph
[19:26] * stiopa (~stiopa@cpc73832-dals21-2-0-cust453.20-2.cable.virginm.net) has joined #ceph
[19:26] * joelc (~joelc@rrcs-71-41-248-34.sw.biz.rr.com) Quit (Remote host closed the connection)
[19:27] * sage_ (~quassel@pool-173-76-103-210.bstnma.fios.verizon.net) Quit (Remote host closed the connection)
[19:28] * rakeshgm (~rakesh@106.51.26.213) has joined #ceph
[19:35] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[19:36] * chardan (~chardan@173.240.241.94) has joined #ceph
[19:40] * Miouge (~Miouge@188.189.72.194) has joined #ceph
[19:43] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[19:43] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[19:45] * abeck (~textual@109.202.107.5) Quit (Quit: Textual IRC Client: www.textualapp.com)
[19:46] <flaf> Hi. I have a question concerning the fsid of a ceph cluster. Is it a security problem to communicate the fsid of a cluster? I think it's not a problem because it seems to me that only keyrings mustn't communicated but I'm not sure. Can you confirm me?
[19:50] * joelc (~joelc@rrcs-71-41-248-34.sw.biz.rr.com) has joined #ceph
[19:51] * Kakeru (~colde@7V7AAFIEI.tor-irc.dnsbl.oftc.net) Quit ()
[19:51] * Helleshin (~ItsCrimin@edwardsnowden1.torservers.net) has joined #ceph
[19:53] * rotbeard (~redbeard@185.32.80.238) Quit (Quit: Leaving)
[19:57] * Racpatel (~Racpatel@c-71-201-162-82.hsd1.il.comcast.net) Quit (Ping timeout: 480 seconds)
[20:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[20:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[20:04] * matejz (~matejz@element.planetq.org) has joined #ceph
[20:04] * Miouge (~Miouge@188.189.72.194) Quit (Quit: Miouge)
[20:05] * Miouge (~Miouge@188.189.72.194) has joined #ceph
[20:05] * ngoswami (~ngoswami@121.244.87.116) Quit (Quit: Leaving)
[20:11] * ntpttr_laptop_ (~ntpttr@134.134.139.82) has joined #ceph
[20:11] * ntpttr_laptop__ (~ntpttr@134.134.139.82) Quit (Remote host closed the connection)
[20:14] * janos_ (~messy@static-71-176-211-4.rcmdva.fios.verizon.net) has joined #ceph
[20:18] * gauravbafna (~gauravbaf@122.167.78.143) has joined #ceph
[20:21] * janos (~messy@static-71-176-211-4.rcmdva.fios.verizon.net) Quit (Ping timeout: 480 seconds)
[20:21] * Miouge (~Miouge@188.189.72.194) Quit (Quit: Miouge)
[20:21] * Helleshin (~ItsCrimin@7V7AAFIGA.tor-irc.dnsbl.oftc.net) Quit ()
[20:21] * maku (~Diablothe@tor.exit-no.de) has joined #ceph
[20:23] * shylesh__ (~shylesh@45.124.227.112) Quit (Remote host closed the connection)
[20:26] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[20:27] * vvb (~vvb@168.235.85.239) Quit (Remote host closed the connection)
[20:29] * m0zes__ (~mozes@n117m02.cis.ksu.edu) has joined #ceph
[20:29] * Miouge (~Miouge@188.189.72.194) has joined #ceph
[20:30] <m0zes__> okay. I???m having some serious issues with ceph that started over the weekend.
[20:31] <m0zes__> running ceph infernalis 9.2.1, have 467 osds, 51 of them are ssds (400GB intel DC P3700). The ssds are hitting suicide timeouts continuously, again, starting this weekend. I???ve been successfully running this setup for almost a year now.
[20:31] * mhackett (~mhack@nat-pool-bos-u.redhat.com) has joined #ceph
[20:32] <m0zes__> The SSDs hold the metadata pool for cephfs. I???ve stopped ceph-mds to try and get this to stabilize.
[20:33] <m0zes__> in the last hour, I???ve had 12 ssds crash due to the suicide timeout. I???ll restart them, and different ones will crash. I???m not seeing any rhyme or reason to it.
[20:33] <m0zes__> I???ve checked the errors on my NICs, not seeing any change from what it has been. I???ve checked the overall load of the cluster, it doesn???t seem to correlate to any increased load.
[20:34] * karnan (~karnan@103.227.97.69) Quit (Quit: Leaving)
[20:34] <m0zes__> I???ve tried moving the metadata pool over to spinning disks, and the suicide timeout follow the pool.
[20:35] <m0zes__> 3 more ssds crashed since the time I joined the channel.
[20:35] * codice (~toodles@75-128-34-237.static.mtpk.ca.charter.com) has joined #ceph
[20:36] * mhack (~mhack@nat-pool-bos-t.redhat.com) Quit (Ping timeout: 480 seconds)
[20:36] <m0zes__> I was going to update to jewel today, but I???d prefer not to do it with a metadata pool constantly in flux and degraded.
[20:37] * c0dice (~toodles@75-128-34-237.static.mtpk.ca.charter.com) Quit (Ping timeout: 480 seconds)
[20:39] <m0zes__> does anyone have any debugging ideas? I???ve stopped all traffic I can think of just to try and get this pool up.
[20:41] * bniver (~bniver@nat-pool-bos-u.redhat.com) Quit (Remote host closed the connection)
[20:42] * gauravbafna (~gauravbaf@122.167.78.143) Quit (Remote host closed the connection)
[20:43] <m0zes__> I???ve restarted all of the ssd osds 3 times now??? I???ve dropped caches, I???ve checked all the smart statii on the nvme disks, I???ve check iostat -x for all the hosts, *nothing* looks out of the norm.
[20:44] <m0zes__> client io 109 kB/s wr, 7 op/s
[20:44] <m0zes__> the cluster is literally doing nothing.
[20:49] * MentalRay (~MentalRay@MTRLPQ42-1176054809.sdsl.bell.ca) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[20:51] * reed (~reed@75-101-54-18.dsl.static.fusionbroadband.com) Quit (Quit: Ex-Chat)
[20:51] * maku (~Diablothe@7V7AAFIHY.tor-irc.dnsbl.oftc.net) Quit ()
[20:53] * MentalRay (~MentalRay@MTRLPQ42-1176054809.sdsl.bell.ca) has joined #ceph
[20:57] * lpabon (~quassel@nat-pool-bos-t.redhat.com) has joined #ceph
[20:57] * nils_ (~nils_@doomstreet.collins.kg) Quit (Read error: Connection reset by peer)
[20:57] * nils_ (~nils_@doomstreet.collins.kg) has joined #ceph
[21:02] * mhack (~mhack@nat-pool-bos-t.redhat.com) has joined #ceph
[21:02] * gauravbafna (~gauravbaf@122.167.78.143) has joined #ceph
[21:04] <PoRNo-MoRoZ> m0zes__
[21:04] <PoRNo-MoRoZ> check auth
[21:04] <PoRNo-MoRoZ> i got some kinda similar problem
[21:04] <PoRNo-MoRoZ> as result - i turned off cephx
[21:09] * mhackett (~mhack@nat-pool-bos-u.redhat.com) Quit (Ping timeout: 480 seconds)
[21:10] * gauravbafna (~gauravbaf@122.167.78.143) Quit (Ping timeout: 480 seconds)
[21:11] * brad[] (~Brad@184-94-17-26.dedicated.allstream.net) has joined #ceph
[21:12] <brad[]> Hi all, I'd like to disable the 'filestore flusher' OSD parameter using injectargs but seem unable to do so - I'm using 0.94.x. Is that not possible? I've seen a bug referencing inability to pass booleans to injectargs.
[21:13] * vata (~vata@207.96.182.162) Quit (Ping timeout: 480 seconds)
[21:19] * abeck (~textual@109.202.107.10) has joined #ceph
[21:21] * sixofour (~Vidi@static-ip-85-25-103-119.inaddr.ip-pool.com) has joined #ceph
[21:34] * rwheeler (~rwheeler@nat-pool-bos-t.redhat.com) has joined #ceph
[21:39] * matejz (~matejz@element.planetq.org) Quit (Quit: matejz)
[21:43] * gauravbafna (~gauravbaf@122.167.78.143) has joined #ceph
[21:44] * rendar (~I@host77-178-dynamic.7-87-r.retail.telecomitalia.it) Quit (Ping timeout: 480 seconds)
[21:49] * i_m (~ivan.miro@nat-5-carp.hcn-strela.ru) Quit (Ping timeout: 480 seconds)
[21:51] * abeck (~textual@109.202.107.10) Quit (Quit: Textual IRC Client: www.textualapp.com)
[21:51] * gauravbafna (~gauravbaf@122.167.78.143) Quit (Ping timeout: 480 seconds)
[21:52] * sixofour (~Vidi@4MJAAFSQG.tor-irc.dnsbl.oftc.net) Quit ()
[21:56] * airsoftglock (~Quackie@85.159.237.210) has joined #ceph
[21:57] * Miouge (~Miouge@188.189.72.194) Quit (Quit: Miouge)
[22:01] * abeck (~textual@109.202.107.10) has joined #ceph
[22:10] * rendar (~I@host77-178-dynamic.7-87-r.retail.telecomitalia.it) has joined #ceph
[22:11] * ntpttr_laptop__ (~ntpttr@192.55.54.45) has joined #ceph
[22:11] * ntpttr_laptop_ (~ntpttr@134.134.139.82) Quit (Remote host closed the connection)
[22:22] * wes_dillingham (~wes_dilli@140.247.242.44) Quit (Quit: wes_dillingham)
[22:24] * onyb (~ani07nov@112.133.232.18) has joined #ceph
[22:26] * airsoftglock (~Quackie@4MJAAFSRY.tor-irc.dnsbl.oftc.net) Quit ()
[22:26] * roaet (~Arfed@tor-exit.dhalgren.org) has joined #ceph
[22:33] * mortn (~mortn@h17n9-t-a12.ias.bredband.telia.com) has joined #ceph
[22:34] * mykola (~Mikolaj@91.245.76.80) Quit (Quit: away)
[22:36] * kmroz (~kilo@00020103.user.oftc.net) Quit (Ping timeout: 480 seconds)
[22:45] * gauravbafna (~gauravbaf@122.167.78.143) has joined #ceph
[22:46] * lpabon (~quassel@nat-pool-bos-t.redhat.com) Quit (Remote host closed the connection)
[22:47] * i_m (~ivan.miro@nat-5-carp.hcn-strela.ru) has joined #ceph
[22:47] * bniver (~bniver@71-9-144-29.static.oxfr.ma.charter.com) has joined #ceph
[22:53] * gauravbafna (~gauravbaf@122.167.78.143) Quit (Ping timeout: 480 seconds)
[22:55] * mhack (~mhack@nat-pool-bos-t.redhat.com) Quit (Remote host closed the connection)
[22:55] * joelc (~joelc@rrcs-71-41-248-34.sw.biz.rr.com) Quit (Remote host closed the connection)
[22:56] * roaet (~Arfed@06SAADA2C.tor-irc.dnsbl.oftc.net) Quit ()
[22:56] * cmrn (~PappI@tor2r.ins.tor.net.eu.org) has joined #ceph
[22:57] * georgem (~Adium@104-222-119-175.cpe.teksavvy.com) Quit (Quit: Leaving.)
[22:58] * nils_ (~nils_@doomstreet.collins.kg) Quit (Quit: This computer has gone to sleep)
[23:01] <flaf> m0zes__: when you said ???ssds are hitting suicide tiemout???, do you mean the OSDs daemon are down? In this case, it seems to me there is no relation with the ceph-mds daemon, no?
[23:02] * johnavp1989 (~jpetrini@8.39.115.8) Quit (Ping timeout: 480 seconds)
[23:05] <flaf> m0zes__: you should maybe start an osd in foreground with the -d (debug) option.
[23:07] <m0zes__> flaf: yeah, I shutdown the mds to try and reduce load the the pool???
[23:09] <flaf> I'm not an expert but when there is something strange, it's often a network problem. No recent changes in your cluster concerning the network?
[23:09] <m0zes__> nope, no recent changes, and these hosts have other pools. and all the other pools are fine.
[23:10] <flaf> And do you have logs when a osd crashes?
[23:11] <m0zes__> at the moment, just ???no reply from osd.${x}??? in the heartbeat check.
[23:11] <m0zes__> for 400-1000 lines, then suicide timeout.
[23:12] <m0zes__> I???m running one in foreground mode now. we???ll see if any more useful info appears.
[23:13] * mortn (~mortn@h17n9-t-a12.ias.bredband.telia.com) Quit (Quit: Leaving)
[23:14] <flaf> It's curious to have crash for only osds dedicated to a specific pool.
[23:15] <m0zes__> yeah, it is *really* weird. even when I stopped all client I/O to the pool, the osds will still drop out.
[23:15] <T1> IO timeouts to the OSD data disks?
[23:15] <m0zes__> the ssds are good for 13000 iops each, this *shouldn???t* be an disk issue.
[23:15] <flaf> Are you sure of your private cluster network?
[23:16] <T1> I remember an older thread about firmware updates to some intel ssds that fixed bus resets and other stuff
[23:16] <T1> but that was S3710 or S3700 afair
[23:16] <raeven> I'm having trouble with my test cluster. All the pgs are stuck in creating+peering and i can't seem to find the problem.
[23:17] <m0zes__> nothing changed. and I checked my graphs of discards and error rates. no increases in discards/s or errors/s. We???re talking *an* error every 10-15 minutes???
[23:17] <m0zes__> raeven: pastebin ceph osd tree?
[23:19] <raeven> m0zes__: http://pastebin.com/nKKhAZkv
[23:20] <[arx]> need a third host or allow balancing at the osd level, not host level
[23:20] <T1> raeven: default CRUSH rules and default pool?
[23:20] <raeven> i have a only a custom pool with size 2
[23:21] <T1> yes, but is it the default one or did you delete it and create a new one?
[23:21] <m0zes__> This is the last 7000 lines of debug from a dying osd??? http://paste.ie/view/b7e7afb9
[23:21] <raeven> deleted the first one
[23:22] <T1> raeven: ok - otherwise I'd suggest adding a third node - otherwise default rules will never be satisfied
[23:23] <T1> m0zes__: I'd write to the developer mailinglist with every scrap of information you have
[23:23] * PavelK (~oftc-webi@88.244.124.189.dynamic.ttnet.com.tr) has joined #ceph
[23:24] <T1> that's the best way of getting hold of someone who understands what happens under the hood
[23:24] <m0zes__> yeah, I know, I was hoping I could grab someone here too...
[23:24] <T1> the
[23:24] <T1> -103> 2016-05-31 16:17:38.805002 7f80f7dd2700 10 osd.53 493518 handle_osd_ping osd.323 10.5.38.21:6839/1011285 says i am down in 493734
[23:24] <T1> lines are strange
[23:25] <T1> almost seems like the OSDs cannot talk to eachother
[23:25] <PavelK> Hello Gyus, is there anyone from development team ? I'm trying to understand ceph-disk prepare and can't follow why journal size always 16GB
[23:26] <PavelK> can anyone clarify?
[23:26] * cmrn (~PappI@06SAADA3U.tor-irc.dnsbl.oftc.net) Quit ()
[23:26] <PavelK> checked ceph_disk/main.py and didn't find any related
[23:27] * LeaChim (~LeaChim@host86-176-96-249.range86-176.btcentralplus.com) Quit (Ping timeout: 480 seconds)
[23:27] <T1> afair prepare uses the entire block device if you give it one - or use 5GB for a file-based one
[23:29] <PavelK> T1: after ceph-disk prepare i can see two partitions on all of my block devices. and journal always 16gb size which is for example /dev/xvdd2
[23:29] <T1> hmm
[23:29] <T1> m0zes__:
[23:29] <T1> -1511> 2016-05-31 16:17:30.698680 7f80d157a700 2 -- 10.5.38.2:0/126196 >> 10.5.38.24:6815/48806 pipe(0x7f81477c0800 sd=141 :0 s=1 pgs=0 cs=0 l=1 c=0x7f813604c900).connect error 10.5.38.24:6815/48806, (111) Connection refused
[23:29] <T1> -1510> 2016-05-31 16:17:30.698751 7f80d157a700 2 -- 10.5.38.2:0/126196 >> 10.5.38.24:6815/48806 pipe(0x7f81477c0800 sd=141 :0 s=1 pgs=0 cs=0 l=1 c=0x7f813604c900).fault (111) Connection refused
[23:29] <PavelK> and /dev/xvdd1 all space which left on device
[23:29] <T1> is that.. expected? did another OSD die?
[23:29] * squizzi (~squizzi@107.13.31.195) Quit (Remote host closed the connection)
[23:29] <mlovell> PavelK. i believe it pulls a config option from ceph.conf or uses a default for the size of the journal when creating an osd.
[23:30] * scg (~zscg@valis.gnu.org) Quit (Ping timeout: 480 seconds)
[23:30] <m0zes__> T1: We???re having ~12-15 osds die per hour with that suicide timeout, so it could be expected.
[23:30] <T1> ok
[23:30] <PavelK> let me check, i just going to create wrapped on ceph with go, due to project needs, and gotta prepare disk before cluster is up, so thats reason of question
[23:32] <PavelK> oh, damn, yes it was in config which provided to me by sysadm
[23:32] <PavelK> Thank you for help
[23:32] <mlovell> np
[23:32] <flaf> m0zes__: no error with your disks ssd?
[23:32] <T1> 16GB seems a bit to the large side, but it shouldn't be a problem in any way
[23:33] <flaf> For instance a filesystem which switches in read only after a problem?
[23:33] * wjw-freebsd (~wjw@smtp.digiware.nl) has joined #ceph
[23:33] * linjan_ (~linjan@176.195.187.182) Quit (Ping timeout: 480 seconds)
[23:33] <m0zes__> flaf: nope, I???ve checked the smart-logs and wear-levels...
[23:33] <mlovell> m0zes__. do you know if the osd that the log is from is ever getting osd_ping_reply messages? it looks like at 16:16:44.079715 it sends out a bunch of osd_ping messages to other osds but i don't see an osd_ping_reply in the log.
[23:34] <PavelK> no there is no problem, i'm just trying to understand how it works from inside, as we trying to make it work on CoreOS
[23:34] <T1> m0zes__: also the custom vendor SMART attribute that smartctl doesn't understand, but that intel uses?
[23:35] <m0zes__> T1: these are the nvme ones that smartctl doesn???t see at all. I???m using nvme-cli to grab them.
[23:35] <T1> ok
[23:35] <PavelK> Thank you all :) have a nice day/evening/afternoon
[23:35] <mlovell> oh. nm. there are ping replys
[23:35] * PavelK (~oftc-webi@88.244.124.189.dynamic.ttnet.com.tr) Quit (Quit: Page closed)
[23:36] <mlovell> m0zes__. are your clocks right?
[23:37] <m0zes__> all synced off a local ntp cluster.
[23:37] <m0zes__> they are all in sync
[23:37] <mlovell> k
[23:42] * rwheeler (~rwheeler@nat-pool-bos-t.redhat.com) Quit (Quit: Leaving)
[23:43] <m0zes__> whelp??? I???m getting ready to head out??? :( wish I had some clue as to what is breaking down.
[23:44] <m0zes__> I???ll put together a message for the mailing list tonight.
[23:44] <mlovell> so this is kind of weird.
[23:44] <mlovell> one osd has a map number of 493527 where everything else is different.
[23:44] <mlovell> looks like osd.377
[23:46] <mlovell> i could be chasing something that doesn't matter though.
[23:47] <m0zes__> newest_map on that one is slightly higher that the newest_map on another osd on that host...
[23:47] <m0zes__> ahh, but that is because the other osd is getting ready to drop out.
[23:48] <m0zes__> anyway, I???m heading out.
[23:48] <flaf> m0zes__: I have found this thread http://www.spinics.net/lists/ceph-devel/msg25215.html where greg farnum seems to say that it happens when threads are stuck.
[23:51] <MentalRay> when using the osd recovery delay flag let say at 900 seconds
[23:51] <MentalRay> anyway you can force to start the recovery prior to the 900 seconds to finish?
[23:54] * ntpttr_laptop__ (~ntpttr@192.55.54.45) Quit (Remote host closed the connection)
[23:56] * m0zes__ (~mozes@n117m02.cis.ksu.edu) Quit (Ping timeout: 480 seconds)
[23:56] * spate (~Mraedis@tor1.mysec-arch.net) has joined #ceph
[23:57] * Lokta (~Lokta@carbon.coe.int) Quit (Ping timeout: 480 seconds)
[23:58] * vbellur (~vijay@2601:18f:700:55b0:5e51:4fff:fee8:6a5c) Quit (Ping timeout: 480 seconds)
[23:59] * vbellur (~vijay@71.234.224.255) has joined #ceph

These logs were automatically created by CephLogBot on irc.oftc.net using the Java IRC LogBot.