#ceph IRC Log

Index

IRC Log for 2016-04-05

Timestamps are in GMT/BST.

[0:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) Quit (Remote host closed the connection)
[0:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) has joined #ceph
[0:01] * Bartek (~Bartek@78.10.243.59) Quit (Ping timeout: 480 seconds)
[0:02] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[0:03] <Foloex> thank you all for your kind help
[0:03] <Foloex> good night
[0:03] * Cory1 (77fc11a3@107.161.19.53) has joined #ceph
[0:03] <Cory1> Does anyone have contact details for a Ceph consultant that might be able to fix an issue for me. Got an OSD that wont start and it appears to have the only copies of a few PG's on it
[0:04] * Foloex (~foloex@81-67-102-161.rev.numericable.fr) Quit (Quit: bye)
[0:04] <Cory1> Here is the interesting log file that is generated when i try and start my OSD in question
[0:04] <Cory1> https://www.dropbox.com/s/i1x2vqcgp7qkr96/ceph-osd.35-3.log?dl=0
[0:05] * davidz1 (~davidz@2605:e000:1313:8003:9c0b:b9a2:d5e0:3618) has joined #ceph
[0:05] * davidz (~davidz@2605:e000:1313:8003:9c0b:b9a2:d5e0:3618) Quit (Read error: Connection reset by peer)
[0:08] * allaok (~allaok@ARennes-658-1-51-139.w2-13.abo.wanadoo.fr) Quit (Quit: Leaving.)
[0:09] * davidz (~davidz@2605:e000:1313:8003:9c0b:b9a2:d5e0:3618) has joined #ceph
[0:10] * davidz1 (~davidz@2605:e000:1313:8003:9c0b:b9a2:d5e0:3618) Quit (Read error: Connection reset by peer)
[0:11] <Cory1> I think it's the journal thats corrupt on this OSD, any ideas how I can recreate a fresh journal?
[0:12] <olid19811115> https://www.sebastien-han.fr/blog/2014/11/27/ceph-recover-osds-after-ssd-journal-failure/
[0:13] <Cory1> Yeah, ive seen that. Does anyone see any problems with rebuilding the Journal on an OSD that wont come up? I can keep a backup of the entire OSD incase it doesnt work
[0:15] * wjw-freebsd (~wjw@smtp.digiware.nl) Quit (Ping timeout: 480 seconds)
[0:19] * linjan__ (~linjan@176.193.197.8) has joined #ceph
[0:20] * Kayla (~rogst@195.22.126.119) has joined #ceph
[0:21] * KungFuHamster (~Guest1390@146.0.43.126) has joined #ceph
[0:22] * fsimonce (~simon@host201-70-dynamic.26-79-r.retail.telecomitalia.it) Quit (Quit: Coyote finally caught me)
[0:27] * linjan_ (~linjan@176.195.243.95) Quit (Ping timeout: 480 seconds)
[0:32] * Axion_Joey (~oftc-webi@static-108-47-170-18.lsanca.fios.frontiernet.net) Quit (Ping timeout: 480 seconds)
[0:33] * jclm (~jclm@ip68-96-198-45.lv.lv.cox.net) has joined #ceph
[0:35] * wjw-freebsd (~wjw@smtp.digiware.nl) has joined #ceph
[0:37] * olid19811115 (~olid1982@aftr-185-17-205-250.dynamic.mnet-online.de) Quit (Ping timeout: 480 seconds)
[0:41] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:246c:eb77:7876:1701) Quit (Ping timeout: 480 seconds)
[0:46] * davidz1 (~davidz@2605:e000:1313:8003:9c0b:b9a2:d5e0:3618) has joined #ceph
[0:46] * davidz (~davidz@2605:e000:1313:8003:9c0b:b9a2:d5e0:3618) Quit (Read error: Connection reset by peer)
[0:48] * darthbacon1 (~Jason@129.24.240.130) Quit (Remote host closed the connection)
[0:48] * darthbacon (~Jason@129.24.240.130) has joined #ceph
[0:50] * johnavp1989 (~jpetrini@pool-100-14-10-2.phlapa.fios.verizon.net) has joined #ceph
[0:50] * Kayla (~rogst@06SAAAX2W.tor-irc.dnsbl.oftc.net) Quit ()
[0:50] * Frymaster (~Bored@relay1.tor.openinternet.io) has joined #ceph
[0:50] * johnavp1989 (~jpetrini@pool-100-14-10-2.phlapa.fios.verizon.net) has left #ceph
[0:50] * KungFuHamster (~Guest1390@6AGAAAEVC.tor-irc.dnsbl.oftc.net) Quit ()
[0:50] * cmrn (~Linkshot@192.42.116.16) has joined #ceph
[0:51] * johnavp1989 (~jpetrini@pool-100-14-10-2.phlapa.fios.verizon.net) has joined #ceph
[0:53] * TomasCZ (~TomasCZ@yes.tenlab.net) Quit (Ping timeout: 480 seconds)
[0:53] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) has joined #ceph
[0:56] * darthbacon (~Jason@129.24.240.130) Quit (Ping timeout: 480 seconds)
[0:59] * johnavp1989 (~jpetrini@pool-100-14-10-2.phlapa.fios.verizon.net) Quit (Ping timeout: 480 seconds)
[1:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) Quit (Remote host closed the connection)
[1:01] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[1:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) has joined #ceph
[1:04] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) has joined #ceph
[1:04] * Skaag (~lunix@65.200.54.234) Quit (Quit: Leaving.)
[1:06] * johnavp1989 (~jpetrini@pool-100-14-10-2.phlapa.fios.verizon.net) has joined #ceph
[1:07] * bugzc-EC (~bugzc_EC@ec2-52-3-149-142.compute-1.amazonaws.com) Quit (Read error: Connection reset by peer)
[1:07] * bugzc_EC (~bugzc_EC@ec2-52-3-149-142.compute-1.amazonaws.com) has joined #ceph
[1:12] * lcurtis_ (~lcurtis@47.19.105.250) Quit (Quit: Ex-Chat)
[1:18] * natarej (~natarej@CPE-101-181-134-103.lnse5.cha.bigpond.net.au) has joined #ceph
[1:20] * Frymaster (~Bored@06SAAAX32.tor-irc.dnsbl.oftc.net) Quit ()
[1:20] * PcJamesy (~Pirate@exit1.ipredator.se) has joined #ceph
[1:20] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[1:20] * cmrn (~Linkshot@4MJAADX9N.tor-irc.dnsbl.oftc.net) Quit ()
[1:20] * Architect (~cryptk@109.201.133.100) has joined #ceph
[1:27] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) has joined #ceph
[1:29] * georgem (~Adium@69-165-151-116.dsl.teksavvy.com) has joined #ceph
[1:31] * wsirc_1777 (~wsirc_177@www.nisys.be) has joined #ceph
[1:35] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[1:41] * xarses (~xarses@64.124.158.100) Quit (Ping timeout: 480 seconds)
[1:43] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) has joined #ceph
[1:46] * RameshN (~rnachimu@101.222.183.43) has joined #ceph
[1:50] * PcJamesy (~Pirate@4MJAADYAP.tor-irc.dnsbl.oftc.net) Quit ()
[1:50] * phyphor (~Xa@193.90.12.88) has joined #ceph
[1:50] * Architect (~cryptk@06SAAAX4X.tor-irc.dnsbl.oftc.net) Quit ()
[1:51] * kefu (~kefu@183.193.163.144) has joined #ceph
[1:51] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[1:55] * sudocat (~dibarra@192.185.1.20) Quit (Ping timeout: 480 seconds)
[1:56] * wsirc_1777 is now known as allen
[1:56] * oms101 (~oms101@p20030057EA04C000C6D987FFFE4339A1.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[1:57] * allen is now known as allens
[1:57] * davidz1 (~davidz@2605:e000:1313:8003:9c0b:b9a2:d5e0:3618) Quit (Read error: Connection reset by peer)
[1:57] * davidz (~davidz@2605:e000:1313:8003:9c0b:b9a2:d5e0:3618) has joined #ceph
[1:57] * jclm (~jclm@ip68-96-198-45.lv.lv.cox.net) Quit (Quit: Leaving.)
[1:58] * angdraug (~angdraug@64.124.158.100) Quit (Quit: Leaving)
[2:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) Quit (Remote host closed the connection)
[2:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) has joined #ceph
[2:03] * xarses (~xarses@50.141.32.159) has joined #ceph
[2:03] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) has joined #ceph
[2:04] * oms101 (~oms101@p20030057EA04D300C6D987FFFE4339A1.dip0.t-ipconnect.de) has joined #ceph
[2:10] * ircolle (~Adium@c-71-229-136-109.hsd1.co.comcast.net) Quit (Quit: Leaving.)
[2:11] * allens (~wsirc_177@www.nisys.be) Quit (Remote host closed the connection)
[2:12] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[2:20] * phyphor (~Xa@4MJAADYBN.tor-irc.dnsbl.oftc.net) Quit ()
[2:20] * brannmar (~PappI@tor-exit-node.gertrude.stuken.me) has joined #ceph
[2:20] * huangjun (~kvirc@113.57.168.154) has joined #ceph
[2:21] * Lea (~LeaChim@host86-168-120-216.range86-168.btcentralplus.com) Quit (Ping timeout: 480 seconds)
[2:21] * davidz1 (~davidz@2605:e000:1313:8003:9c0b:b9a2:d5e0:3618) has joined #ceph
[2:21] * davidz (~davidz@2605:e000:1313:8003:9c0b:b9a2:d5e0:3618) Quit (Read error: Connection reset by peer)
[2:25] * Eric1 (~W|ldCraze@Relay-J.tor-exit.network) has joined #ceph
[2:25] * xarses (~xarses@50.141.32.159) Quit (Ping timeout: 480 seconds)
[2:26] * DV_ (~veillard@2001:41d0:a:f29f::1) has joined #ceph
[2:30] * rlord (~rlord@c-24-34-70-97.hsd1.nh.comcast.net) has joined #ceph
[2:31] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) has joined #ceph
[2:31] * mivaho (~quassel@2001:983:eeb4:1:c0de:69ff:fe2f:5599) Quit (Read error: No route to host)
[2:32] * mivaho (~quassel@2001:983:eeb4:1:c0de:69ff:fe2f:5599) has joined #ceph
[2:33] * rlord (~rlord@c-24-34-70-97.hsd1.nh.comcast.net) has left #ceph
[2:37] * Cory1 (77fc11a3@107.161.19.53) Quit (Quit: http://www.kiwiirc.com/ - A hand crafted IRC client)
[2:39] * bjornar_ (~bjornar@ti0099a430-1561.bb.online.no) Quit (Ping timeout: 480 seconds)
[2:46] * davidz1 (~davidz@2605:e000:1313:8003:9c0b:b9a2:d5e0:3618) Quit (Quit: Leaving.)
[2:46] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) Quit (Remote host closed the connection)
[2:49] * linuxkidd (~linuxkidd@29.sub-70-193-113.myvzw.com) Quit (Ping timeout: 480 seconds)
[2:50] * brannmar (~PappI@4MJAADYCN.tor-irc.dnsbl.oftc.net) Quit ()
[2:50] * Maariu5_ (~datagutt@tor.piratenpartei-nrw.de) has joined #ceph
[2:55] * Eric1 (~W|ldCraze@6AGAAAE10.tor-irc.dnsbl.oftc.net) Quit ()
[2:55] * CoMa (~SweetGirl@exit1.ipredator.se) has joined #ceph
[2:56] * xarses (~xarses@50.141.33.103) has joined #ceph
[2:56] * kefu (~kefu@183.193.163.144) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[2:57] * davidzlap (~Adium@2605:e000:1313:8003:25af:472e:5f4e:b2c8) has joined #ceph
[3:00] * xarses_ (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) has joined #ceph
[3:00] * swami1 (~swami@27.7.172.84) has joined #ceph
[3:00] * DV_ (~veillard@2001:41d0:a:f29f::1) Quit (Ping timeout: 480 seconds)
[3:00] * kefu (~kefu@183.193.163.144) has joined #ceph
[3:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) Quit (Remote host closed the connection)
[3:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) has joined #ceph
[3:03] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) has joined #ceph
[3:07] * xarses (~xarses@50.141.33.103) Quit (Ping timeout: 480 seconds)
[3:07] * swami2 (~swami@27.7.172.84) has joined #ceph
[3:08] * motk (~motk@2600:3c00::f03c:91ff:fe98:51ee) Quit (Quit: Lost terminal)
[3:13] * swami1 (~swami@27.7.172.84) Quit (Ping timeout: 480 seconds)
[3:20] * Maariu5_ (~datagutt@4MJAADYDS.tor-irc.dnsbl.oftc.net) Quit ()
[3:22] * kefu (~kefu@183.193.163.144) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[3:23] * EinstCrazy (~EinstCraz@58.247.119.250) has joined #ceph
[3:25] * CoMa (~SweetGirl@4MJAADYDX.tor-irc.dnsbl.oftc.net) Quit ()
[3:25] * `Jin (~Inuyasha@62.102.148.67) has joined #ceph
[3:30] * kefu (~kefu@183.193.163.144) has joined #ceph
[3:30] * johnavp1989 (~jpetrini@pool-100-14-10-2.phlapa.fios.verizon.net) Quit (Ping timeout: 480 seconds)
[3:33] * kefu (~kefu@183.193.163.144) Quit ()
[3:34] * efirs (~firs@c-50-185-70-125.hsd1.ca.comcast.net) has joined #ceph
[3:37] * ira (~ira@c-24-34-255-34.hsd1.ma.comcast.net) Quit (Quit: Leaving)
[3:41] * davidzlap (~Adium@2605:e000:1313:8003:25af:472e:5f4e:b2c8) Quit (Quit: Leaving.)
[3:42] * vasu (~vasu@c-73-231-60-138.hsd1.ca.comcast.net) Quit (Quit: Leaving)
[3:43] * zhaochao_ (~zhaochao@125.39.9.156) has joined #ceph
[3:44] * johnavp1989 (~jpetrini@pool-100-14-10-2.phlapa.fios.verizon.net) has joined #ceph
[3:46] * davidzlap (~Adium@cpe-172-91-154-245.socal.res.rr.com) has joined #ceph
[3:48] * davidzlap (~Adium@cpe-172-91-154-245.socal.res.rr.com) Quit ()
[3:50] * nupanick (~AluAlu@93.115.95.204) has joined #ceph
[3:51] * yanzheng (~zhyan@118.116.113.6) has joined #ceph
[3:55] * `Jin (~Inuyasha@06SAAAX9S.tor-irc.dnsbl.oftc.net) Quit ()
[4:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) Quit (Remote host closed the connection)
[4:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) has joined #ceph
[4:08] * haomaiwang (~haomaiwan@li745-113.members.linode.com) Quit (Remote host closed the connection)
[4:13] * swami2 (~swami@27.7.172.84) Quit (Quit: Leaving.)
[4:16] * EinstCra_ (~EinstCraz@58.247.119.250) has joined #ceph
[4:20] * nupanick (~AluAlu@4MJAADYFI.tor-irc.dnsbl.oftc.net) Quit ()
[4:20] * SEBI1 (~rushworld@4MJAADYF9.tor-irc.dnsbl.oftc.net) has joined #ceph
[4:21] * huangjun (~kvirc@113.57.168.154) Quit (Ping timeout: 480 seconds)
[4:21] * gopher_49 (~gopher_49@75.66.43.16) has joined #ceph
[4:24] * EinstCrazy (~EinstCraz@58.247.119.250) Quit (Ping timeout: 480 seconds)
[4:25] * poller (~ain@93.115.95.204) has joined #ceph
[4:27] * lxo (~aoliva@lxo.user.oftc.net) Quit (Remote host closed the connection)
[4:28] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[4:29] * swami1 (~swami@27.7.172.84) has joined #ceph
[4:32] * swami1 (~swami@27.7.172.84) Quit ()
[4:36] * shyu (~Shanzhi@119.254.120.67) has joined #ceph
[4:37] * Racpatel (~Racpatel@2601:87:3:3601::4edb) Quit (Quit: Leaving)
[4:38] * haomaiwang (~haomaiwan@li745-113.members.linode.com) has joined #ceph
[4:44] * johnavp1989 (~jpetrini@pool-100-14-10-2.phlapa.fios.verizon.net) Quit (Ping timeout: 480 seconds)
[4:50] * SEBI1 (~rushworld@4MJAADYF9.tor-irc.dnsbl.oftc.net) Quit ()
[4:50] * Kakeru (~SaneSmith@151.80.175.238) has joined #ceph
[4:50] * RameshN (~rnachimu@101.222.183.43) Quit (Ping timeout: 480 seconds)
[4:55] * poller (~ain@06SAAAYBV.tor-irc.dnsbl.oftc.net) Quit ()
[4:55] * Misacorp (~Zyn@195.40.181.35) has joined #ceph
[4:56] * johnavp1989 (~jpetrini@pool-100-14-10-2.phlapa.fios.verizon.net) has joined #ceph
[4:57] * haomaiwa_ (~haomaiwan@li745-113.members.linode.com) has joined #ceph
[4:58] * haomaiwang (~haomaiwan@li745-113.members.linode.com) Quit (Remote host closed the connection)
[5:00] * huangjun (~kvirc@113.57.168.154) has joined #ceph
[5:01] * haomaiwa_ (~haomaiwan@li745-113.members.linode.com) Quit (Remote host closed the connection)
[5:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) has joined #ceph
[5:13] * rakeshgm (~rakesh@106.51.225.4) Quit (Quit: Leaving)
[5:14] * wjw-freebsd (~wjw@smtp.digiware.nl) Quit (Ping timeout: 480 seconds)
[5:20] * Kakeru (~SaneSmith@06SAAAYCQ.tor-irc.dnsbl.oftc.net) Quit ()
[5:20] * Fapiko (~Nanobot@195.22.126.119) has joined #ceph
[5:25] * Misacorp (~Zyn@4MJAADYHL.tor-irc.dnsbl.oftc.net) Quit ()
[5:26] * overclk (~quassel@121.244.87.117) has joined #ceph
[5:27] * shyu (~Shanzhi@119.254.120.67) Quit (Ping timeout: 480 seconds)
[5:27] * PaulCuzner (~paul@115-188-90-87.jetstream.xtra.co.nz) has joined #ceph
[5:29] * Vacuum__ (~Vacuum@i59F79D27.versanet.de) has joined #ceph
[5:36] * Vacuum_ (~Vacuum@i59F7929F.versanet.de) Quit (Ping timeout: 480 seconds)
[5:36] * kefu (~kefu@183.193.163.144) has joined #ceph
[5:38] * johnavp1989 (~jpetrini@pool-100-14-10-2.phlapa.fios.verizon.net) Quit (Ping timeout: 480 seconds)
[5:40] * shyu (~Shanzhi@119.254.120.66) has joined #ceph
[5:41] * shyu (~Shanzhi@119.254.120.66) Quit (Remote host closed the connection)
[5:41] * shyu (~Shanzhi@119.254.120.66) has joined #ceph
[5:50] * Fapiko (~Nanobot@4MJAADYH6.tor-irc.dnsbl.oftc.net) Quit ()
[5:50] * nastidon (~matx@06SAAAYEP.tor-irc.dnsbl.oftc.net) has joined #ceph
[5:53] * Zabidin (~oftc-webi@124.13.35.225) has joined #ceph
[5:53] <Zabidin> Hello expert..
[5:53] <Zabidin> Having problem prepare osd disk using journal (ssd)
[5:54] <Zabidin> Execute on osd01 (box): /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:95acaa3a-79a5-46cf-8f0e-86ef148ea34c --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdd Problem opening data for reading! Error is 2. The specified file does not exist!
[5:55] * CorneliousJD|AtWork (~Shesh@86.104.15.15) has joined #ceph
[5:58] * georgem (~Adium@69-165-151-116.dsl.teksavvy.com) Quit (Quit: Leaving.)
[6:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) Quit (Remote host closed the connection)
[6:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) has joined #ceph
[6:07] * rdas (~rdas@121.244.87.116) has joined #ceph
[6:07] <skullone> has anyone tried putting billions of objects in a ceph rgw?
[6:08] * vikhyat (~vumrao@121.244.87.116) has joined #ceph
[6:13] * ibravo (~ibravo@72.198.142.104) Quit (Ping timeout: 480 seconds)
[6:18] * lxo (~aoliva@lxo.user.oftc.net) Quit (Remote host closed the connection)
[6:19] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[6:19] * IvanJobs (~hardes@103.50.11.146) has joined #ceph
[6:20] * nastidon (~matx@06SAAAYEP.tor-irc.dnsbl.oftc.net) Quit ()
[6:20] * Drezil1 (~Random@93.115.95.202) has joined #ceph
[6:20] <IvanJobs> Hey guys, how to make Ceph RGW support jsonp? any info would be appreciated.
[6:22] * Frank_ (~Frank@149.210.210.150) Quit (Read error: Connection reset by peer)
[6:22] * Frank_ (~Frank@149.210.210.150) has joined #ceph
[6:25] * CorneliousJD|AtWork (~Shesh@6AGAAAFB4.tor-irc.dnsbl.oftc.net) Quit ()
[6:25] * Harryhy (~zviratko@37.48.80.101) has joined #ceph
[6:28] * davidzlap (~Adium@2605:e000:1313:8003:95fa:9f0e:dd9e:a6d4) has joined #ceph
[6:30] * rdas (~rdas@121.244.87.116) Quit (Quit: Leaving)
[6:40] * kefu_ (~kefu@114.92.120.83) has joined #ceph
[6:43] * kefu (~kefu@183.193.163.144) Quit (Ping timeout: 480 seconds)
[6:45] * haomaiwang (~haomaiwan@li745-113.members.linode.com) Quit (Ping timeout: 480 seconds)
[6:50] * Drezil1 (~Random@4MJAADYJZ.tor-irc.dnsbl.oftc.net) Quit ()
[6:50] * dontron (~Silentkil@91.250.241.241) has joined #ceph
[6:55] * Harryhy (~zviratko@6AGAAAFDC.tor-irc.dnsbl.oftc.net) Quit ()
[6:55] * Defaultti1 (~Neon@digi00810.digicube.fr) has joined #ceph
[6:56] * huangjun (~kvirc@113.57.168.154) Quit (Ping timeout: 480 seconds)
[6:57] * huangjun (~kvirc@113.57.168.154) has joined #ceph
[7:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) has joined #ceph
[7:01] * darthbacon (~Jason@129.24.240.130) has joined #ceph
[7:08] * masterom1 (~ivan@93-142-193-60.adsl.net.t-com.hr) has joined #ceph
[7:09] * winston-d_ (uid98317@id-98317.richmond.irccloud.com) has joined #ceph
[7:10] * ifur (~osm@0001f63e.user.oftc.net) Quit (Ping timeout: 480 seconds)
[7:13] * kefu_ (~kefu@114.92.120.83) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[7:15] * masteroman (~ivan@93-142-231-121.adsl.net.t-com.hr) Quit (Ping timeout: 480 seconds)
[7:20] * dontron (~Silentkil@06SAAAYGT.tor-irc.dnsbl.oftc.net) Quit ()
[7:20] * Kwen (~anadrom@tor-exit-01.1d4.us) has joined #ceph
[7:21] * zaitcev (~zaitcev@c-50-130-189-82.hsd1.nm.comcast.net) Quit (Quit: Bye)
[7:25] * Defaultti1 (~Neon@6AGAAAFEK.tor-irc.dnsbl.oftc.net) Quit ()
[7:25] * chrisinajar (~Helleshin@6AGAAAFFD.tor-irc.dnsbl.oftc.net) has joined #ceph
[7:28] * rotbeard (~redbeard@185.32.80.238) has joined #ceph
[7:29] * darthbacon (~Jason@129.24.240.130) Quit (Quit: Leaving.)
[7:31] * kefu (~kefu@183.193.163.144) has joined #ceph
[7:33] * Miouge (~Miouge@h-72-233.a163.priv.bahnhof.se) has joined #ceph
[7:37] * EinstCrazy (~EinstCraz@58.247.119.250) has joined #ceph
[7:38] * kefu_ (~kefu@114.92.120.83) has joined #ceph
[7:39] * gopher_49 (~gopher_49@75.66.43.16) Quit (Ping timeout: 480 seconds)
[7:39] * Miouge (~Miouge@h-72-233.a163.priv.bahnhof.se) Quit (Quit: Miouge)
[7:43] * kefu (~kefu@183.193.163.144) Quit (Ping timeout: 480 seconds)
[7:44] * EinstCra_ (~EinstCraz@58.247.119.250) Quit (Ping timeout: 480 seconds)
[7:45] * ifur (~osm@0001f63e.user.oftc.net) has joined #ceph
[7:50] * Kwen (~anadrom@06SAAAYHY.tor-irc.dnsbl.oftc.net) Quit ()
[7:50] * zviratko (~Lattyware@atlantic480.us.unmetered.com) has joined #ceph
[7:55] * chrisinajar (~Helleshin@6AGAAAFFD.tor-irc.dnsbl.oftc.net) Quit ()
[7:55] * sardonyx (~Rehevkor@94.242.195.186) has joined #ceph
[8:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) Quit (Remote host closed the connection)
[8:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) has joined #ceph
[8:01] * RameshN (~rnachimu@121.244.87.117) has joined #ceph
[8:06] * zhaochao_ (~zhaochao@125.39.9.156) Quit (Read error: Connection reset by peer)
[8:07] * d0m0reg00dthing (~textual@176.223.111.118) has joined #ceph
[8:07] * zhaochao (~zhaochao@125.39.9.156) has joined #ceph
[8:07] * linjan__ (~linjan@176.193.197.8) Quit (Ping timeout: 480 seconds)
[8:08] * krobelus (~krobelus@178-191-104-25.adsl.highway.telekom.at) has joined #ceph
[8:14] * krobelus_ (~krobelus@80-121-72-207.adsl.highway.telekom.at) Quit (Ping timeout: 480 seconds)
[8:15] <Zabidin> Any expert here..
[8:15] <Zabidin> ?
[8:16] * dyasny (~dyasny@46.117.8.108) has joined #ceph
[8:18] * Be-El (~blinke@nat-router.computational.bio.uni-giessen.de) has joined #ceph
[8:19] * swami1 (~swami@49.44.57.242) has joined #ceph
[8:20] * zviratko (~Lattyware@6AGAAAFGD.tor-irc.dnsbl.oftc.net) Quit ()
[8:25] * sardonyx (~Rehevkor@4MJAADYMV.tor-irc.dnsbl.oftc.net) Quit ()
[8:25] * Scymex1 (~Diablothe@tor1e1.privacyfoundation.ch) has joined #ceph
[8:28] <Zabidin> How to make osd up > [root@mon01 ceph]# ceph osd tree ID WEIGHT TYPE NAME UP/DOWN REWEIGHT PRIMARY-AFFINITY -1 0 root default 0 0 osd.0 down 0 1.00000 1 0 osd.1 down 0 1.00000 ?
[8:33] * Hemanth (~hkumar_@121.244.87.117) has joined #ceph
[8:33] * swami2 (~swami@49.32.0.124) has joined #ceph
[8:34] * karnan (~karnan@121.244.87.117) has joined #ceph
[8:37] * dugravot6 (~dugravot6@dn-infra-04.lionnois.site.univ-lorraine.fr) has joined #ceph
[8:38] * swami1 (~swami@49.44.57.242) Quit (Ping timeout: 480 seconds)
[8:42] * dugravot6 (~dugravot6@dn-infra-04.lionnois.site.univ-lorraine.fr) Quit ()
[8:44] * T1w (~jens@node3.survey-it.dk) has joined #ceph
[8:49] * derjohn_mob (~aj@p578b6aa1.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[8:50] <IvanJobs> you may try "start ceph-osd id=1"
[8:50] <IvanJobs> @Zabidin
[8:55] * Scymex1 (~Diablothe@06SAAAYJV.tor-irc.dnsbl.oftc.net) Quit ()
[8:55] * FierceForm (~Corti^car@freedom.ip-eend.nl) has joined #ceph
[8:55] * DV_ (~veillard@2001:41d0:a:f29f::1) has joined #ceph
[9:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) Quit (Remote host closed the connection)
[9:01] <Zabidin> IvanJobs: I already uninstall it.. Purge data.. Try install back..
[9:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) has joined #ceph
[9:02] <IvanJobs> which version of ceph do u install?
[9:06] * bjornar_ (~bjornar@ti0099a430-1561.bb.online.no) has joined #ceph
[9:07] * analbeard (~shw@support.memset.com) has joined #ceph
[9:07] <Zabidin> IvanJobs: ceph-deploy ver 1.5.31, ceph ver 9.2.1
[9:08] * Zabidin (~oftc-webi@124.13.35.225) Quit (Quit: Page closed)
[9:08] * kefu_ (~kefu@114.92.120.83) Quit (Max SendQ exceeded)
[9:08] * Zabidin (~oftc-webi@124.13.35.225) has joined #ceph
[9:08] * kefu (~kefu@114.92.120.83) has joined #ceph
[9:08] <Zabidin> IvanJobs: This is infernalis release.
[9:09] * dgurtner (~dgurtner@82.199.64.68) has joined #ceph
[9:10] <IvanJobs> Zabidin: you may try reinstall ceph, if osd is not up, try the comand I offered above.
[9:11] * rendar (~I@host189-116-dynamic.53-82-r.retail.telecomitalia.it) has joined #ceph
[9:13] * derjohn_mob (~aj@fw.gkh-setu.de) has joined #ceph
[9:14] * branto (~branto@ip-78-102-208-181.net.upcbroadband.cz) has joined #ceph
[9:14] * kawa2014 (~kawa@89.184.114.246) has joined #ceph
[9:18] <Zabidin> IvanJobs: What is step for prepare hdd(data) and ssd (journal)?
[9:18] * Geph (~Geoffrey@41.77.153.99) has joined #ceph
[9:19] <Zabidin> IvanJobs: all node need same kernel or not?
[9:20] * OODavo1 (~brianjjo@tor1e1.privacyfoundation.ch) has joined #ceph
[9:20] * hr__ (~hardes@122.14.140.7) has joined #ceph
[9:22] * IvanJobs (~hardes@103.50.11.146) Quit (Read error: Connection reset by peer)
[9:22] * hr__ (~hardes@122.14.140.7) Quit (Read error: Connection reset by peer)
[9:23] * IvanJobs (~hardes@103.50.11.146) has joined #ceph
[9:23] * branto (~branto@ip-78-102-208-181.net.upcbroadband.cz) Quit (Quit: Leaving.)
[9:24] * branto (~branto@ip-78-102-208-181.net.upcbroadband.cz) has joined #ceph
[9:24] <IvanJobs> wait for a while for the first question. the second is "you'd better use same os environment", for example, same ubuntu or centos.
[9:25] * FierceForm (~Corti^car@4MJAADYO1.tor-irc.dnsbl.oftc.net) Quit ()
[9:25] * tZ (~Tralin|Sl@ns330209.ip-5-196-66.eu) has joined #ceph
[9:26] <IvanJobs> Zabidin: as to the first question, you may refer to this link http://docs.ceph.com/docs/master/install/manual-deployment/#short-form
[9:26] <IvanJobs> when prepare osd, you can set your data-path and journal-path.
[9:27] <Zabidin> IvanJobs: Where i can get cluster uuid?
[9:28] <IvanJobs> Zabidin: your config file:ceph.conf
[9:29] <IvanJobs> BTW, I think you should look into the officail docs first, after that these question would be easy to solve.
[9:31] * linjan__ (~linjan@86.62.112.22) has joined #ceph
[9:32] * efirs (~firs@c-50-185-70-125.hsd1.ca.comcast.net) Quit (Quit: Leaving.)
[9:32] * fsimonce (~simon@host201-70-dynamic.26-79-r.retail.telecomitalia.it) has joined #ceph
[9:34] * evelu (~erwan@37.161.84.203) has joined #ceph
[9:37] * DV_ (~veillard@2001:41d0:a:f29f::1) Quit (Quit: Leaving)
[9:39] <Zabidin> IvanJobs: WARNING:ceph-disk:Journal /dev/sde1 was not prepared with ceph-disk. Symlinking directly.
[9:42] <Zabidin> IvanJobs: Error > http://pastebin.com/KSPdZua4
[9:42] * TMM (~hp@178-84-46-106.dynamic.upc.nl) Quit (Quit: Ex-Chat)
[9:44] * DV_ (~veillard@2001:41d0:a:f29f::1) has joined #ceph
[9:50] * OODavo1 (~brianjjo@6AGAAAFJ9.tor-irc.dnsbl.oftc.net) Quit ()
[9:50] * slowriot (~Freddy@4MJAADYQV.tor-irc.dnsbl.oftc.net) has joined #ceph
[9:55] * DanFoster (~Daniel@2a00:1ee0:3:1337:7962:6f0c:73a:30c1) has joined #ceph
[9:55] * tZ (~Tralin|Sl@6AGAAAFKF.tor-irc.dnsbl.oftc.net) Quit ()
[9:55] * Vale (~cheese^@95.128.43.164) has joined #ceph
[9:58] * jordanP (~jordan@204.13-14-84.ripe.coltfrance.com) has joined #ceph
[10:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) Quit (Remote host closed the connection)
[10:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) has joined #ceph
[10:04] * rraja (~rraja@121.244.87.117) has joined #ceph
[10:14] * Zabidin (~oftc-webi@124.13.35.225) Quit (Ping timeout: 480 seconds)
[10:16] * derjohn_mob (~aj@fw.gkh-setu.de) Quit (Ping timeout: 480 seconds)
[10:20] * slowriot (~Freddy@4MJAADYQV.tor-irc.dnsbl.oftc.net) Quit ()
[10:20] * Dysgalt (~thundercl@mumble-01.oasisol.com) has joined #ceph
[10:22] * olid19811115 (~olid1982@aftr-88-217-181-40.dynamic.mnet-online.de) has joined #ceph
[10:22] * d0m0reg00dthing (~textual@176.223.111.118) Quit (Ping timeout: 480 seconds)
[10:24] * TMM (~hp@185.5.122.2) has joined #ceph
[10:25] * Vale (~cheese^@06SAAAYMZ.tor-irc.dnsbl.oftc.net) Quit ()
[10:25] * Wizeon1 (~mLegion@edwardsnowden2.torservers.net) has joined #ceph
[10:26] * derjohn_mob (~aj@fw.gkh-setu.de) has joined #ceph
[10:29] * ade (~abradshaw@212.77.58.61) has joined #ceph
[10:35] * The1w (~jens@node3.survey-it.dk) has joined #ceph
[10:35] * T1w (~jens@node3.survey-it.dk) Quit (Ping timeout: 480 seconds)
[10:35] * Lea (~LeaChim@host86-168-120-216.range86-168.btcentralplus.com) has joined #ceph
[10:40] * Kurt (~Adium@2001:628:1:5:49fd:1c10:5b19:4293) has joined #ceph
[10:50] * Dysgalt (~thundercl@4MJAADYRX.tor-irc.dnsbl.oftc.net) Quit ()
[10:50] * Salamander_ (~Sophie@85.159.237.210) has joined #ceph
[10:51] * bara (~bara@nat-pool-brq-t.redhat.com) has joined #ceph
[10:55] * Wizeon1 (~mLegion@6AGAAAFM5.tor-irc.dnsbl.oftc.net) Quit ()
[10:55] * demonspork (~Mraedis@93.115.95.207) has joined #ceph
[11:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) Quit (Remote host closed the connection)
[11:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) has joined #ceph
[11:10] * evelu (~erwan@37.161.84.203) Quit (Read error: Connection reset by peer)
[11:20] * Salamander_ (~Sophie@4MJAADYSV.tor-irc.dnsbl.oftc.net) Quit ()
[11:20] * KristopherBel (~Fapiko@tor-exit-01.1d4.us) has joined #ceph
[11:20] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:246c:eb77:7876:1701) has joined #ceph
[11:21] * zhaochao_ (~zhaochao@125.39.9.144) has joined #ceph
[11:23] * EinstCra_ (~EinstCraz@58.247.119.250) has joined #ceph
[11:25] * demonspork (~Mraedis@6AGAAAFOC.tor-irc.dnsbl.oftc.net) Quit ()
[11:25] * rushworld (~capitalth@94.242.228.107) has joined #ceph
[11:26] * zhaochao (~zhaochao@125.39.9.156) Quit (Ping timeout: 480 seconds)
[11:26] * zhaochao_ is now known as zhaochao
[11:27] * evelu (~erwan@37.161.84.203) has joined #ceph
[11:30] * EinstCrazy (~EinstCraz@58.247.119.250) Quit (Ping timeout: 480 seconds)
[11:35] * evelu (~erwan@37.161.84.203) Quit (Ping timeout: 480 seconds)
[11:38] * Concubidated (~cube@c-50-173-245-118.hsd1.ca.comcast.net) Quit (Quit: Leaving.)
[11:42] * ngoswami (~ngoswami@121.244.87.116) has joined #ceph
[11:43] * evelu (~erwan@37.164.112.0) has joined #ceph
[11:45] * ngoswami (~ngoswami@121.244.87.116) Quit ()
[11:50] * KristopherBel (~Fapiko@06SAAAYP1.tor-irc.dnsbl.oftc.net) Quit ()
[11:50] * Maza (~Freddy@tor01.zencurity.dk) has joined #ceph
[11:50] * shyu (~Shanzhi@119.254.120.66) Quit (Ping timeout: 480 seconds)
[11:51] * ngoswami (~ngoswami@121.244.87.116) has joined #ceph
[11:55] * rushworld (~capitalth@4MJAADYTU.tor-irc.dnsbl.oftc.net) Quit ()
[11:55] * raindog (~Scrin@anonymous6.sec.nl) has joined #ceph
[12:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) Quit (Remote host closed the connection)
[12:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) has joined #ceph
[12:03] * ngoswami (~ngoswami@121.244.87.116) Quit (Quit: This computer has gone to sleep)
[12:08] * yuxiaozou (~yuxiaozou@128.135.100.101) Quit (Ping timeout: 480 seconds)
[12:14] * EinstCra_ (~EinstCraz@58.247.119.250) Quit (Remote host closed the connection)
[12:14] * EinstCrazy (~EinstCraz@58.247.119.250) has joined #ceph
[12:16] * mikecao (~caobo@27.115.104.75) has joined #ceph
[12:20] * Maza (~Freddy@4MJAADYUI.tor-irc.dnsbl.oftc.net) Quit ()
[12:20] * jwandborg (~Oddtwang@192.87.28.82) has joined #ceph
[12:20] <mikecao> Hi experts . we are using ceph version 0.80.7 (6c0127fcb58008793d3c8b62d925bc91963672a , we find some osd service down w/ "2016-04-05 17:34:21.569602 7f602fbb87c0 -1 asok(0x7f60316f8150) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/ceph-osd.96.asok': (17) File exists
[12:20] <mikecao> 2016-04-05 17:34:21.569631 7f602fbb87c0 0 filestore(/var/lib/ceph/osd/ceph-96) lock_fsid failed to lock /var/lib/ceph/osd/ceph-96/fsid, is another ceph-osd still running? (11) Resource temporarily unavailable
[12:20] <mikecao> 2016-04-05 17:34:21.569637 7f602fbb87c0 -1 filestore(/var/lib/ceph/osd/ceph-96) FileStore::mount: lock_fsid failed
[12:20] * bara (~bara@nat-pool-brq-t.redhat.com) Quit (Remote host closed the connection)
[12:20] <mikecao> any idea about it?
[12:22] * bara (~bara@nat-pool-brq-t.redhat.com) has joined #ceph
[12:22] * EinstCrazy (~EinstCraz@58.247.119.250) Quit (Ping timeout: 480 seconds)
[12:25] * raindog (~Scrin@4MJAADYUM.tor-irc.dnsbl.oftc.net) Quit ()
[12:25] * Mattress (~skrblr@marylou.nos-oignons.net) has joined #ceph
[12:25] <etienneme> Maybe it crashed and the socket was not deleted ?
[12:25] <etienneme> I would say... reboot :p
[12:26] <etienneme> Or try to manually clean :)
[12:26] * overclk (~quassel@121.244.87.117) Quit (Remote host closed the connection)
[12:27] * ngoswami (~ngoswami@121.244.87.116) has joined #ceph
[12:27] * rotbeard (~redbeard@185.32.80.238) Quit (Quit: Leaving)
[12:30] * olid19811115 (~olid1982@aftr-88-217-181-40.dynamic.mnet-online.de) Quit (Ping timeout: 480 seconds)
[12:31] <mikecao> etienneme, service reboot failed
[12:33] <mikecao> etienneme, we tried lsof /var/run/ceph/ceph-osd.96.asok , the process is binded to a ceph-osd . kill the ceph-osd will cause data lose ?
[12:38] <etienneme> It should not, you are using replication or erasure coding?
[12:39] <etienneme> Anyway, the OSD is already down
[12:40] * karnan (~karnan@121.244.87.117) Quit (Ping timeout: 480 seconds)
[12:42] * winston-d_ (uid98317@id-98317.richmond.irccloud.com) Quit (Quit: Connection closed for inactivity)
[12:46] <mikecao> etienneme, we are using replication. the service of OSD is failed ,but the ceph-osd process is still running and osd is up
[12:46] <mikecao> the cluster of ceph is "OK"
[12:49] * karnan (~karnan@121.244.87.124) has joined #ceph
[12:49] <etienneme> but what does a ceph -s says?
[12:49] <etienneme> you can have a cluster health OK but an osd down
[12:49] <etienneme> you have a line with osd count
[12:50] <mikecao> cluster 2645bbf6-16d0-4c42-8835-8ba9f5c95a1d
[12:50] <mikecao> health HEALTH_OK
[12:50] <mikecao> monmap e1: 3 mons at {helion-cp1-core-m1-osdc=10.1.172.2:6789/0,helion-cp1-core-m2-osdc=10.1.172.3:6789/0,helion-cp1-core-m3-osdc=10.1.172.4:6789/0}, election epoch 110, quorum 0,1,2 helion-cp1-core-m1-osdc,helion-cp1-core-m2-osdc,helion-cp1-core-m3-osdc
[12:50] <mikecao> osdmap e24393: 140 osds: 140 up, 140 in
[12:50] <mikecao> pgmap v379664: 10240 pgs, 5 pools, 74237 MB data, 16229 objects
[12:50] <mikecao> 282 GB used, 228 TB / 229 TB avail
[12:50] <etienneme> seems OK
[12:50] * jwandborg (~Oddtwang@4MJAADYVI.tor-irc.dnsbl.oftc.net) Quit ()
[12:50] <mikecao> 10240 active+clean
[12:50] <mikecao> client io 0 B/s rd, 123 kB/s wr, 75 op/s
[12:51] <etienneme> How do you know your OSD is down? requesting status on daemon?
[12:52] <mikecao> according to #ceph-s ,all osd are up , it is werid that
[12:53] <mikecao> sudo systemctl status ceph-osd@96
[12:53] <mikecao> ?? ceph-osd@96.service - Ceph object storage daemon
[12:53] <mikecao> Loaded: loaded (/etc/systemd/system/ceph-osd@.service; enabled)
[12:53] <mikecao> Active: failed (Result: exit-code) since Tue 2016-04-05 18:22:54 UTC; 30min ago
[12:53] * bjornar_ (~bjornar@ti0099a430-1561.bb.online.no) Quit (Ping timeout: 480 seconds)
[12:54] * huangjun (~kvirc@113.57.168.154) Quit (Ping timeout: 480 seconds)
[12:55] * Mattress (~skrblr@06SAAAYSP.tor-irc.dnsbl.oftc.net) Quit ()
[12:55] * Aramande_ (~Rosenblut@88.79-160-125.customer.lyse.net) has joined #ceph
[12:58] * karnan (~karnan@121.244.87.124) Quit (Ping timeout: 480 seconds)
[13:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) Quit (Remote host closed the connection)
[13:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) has joined #ceph
[13:05] * overclk (~quassel@117.202.104.75) has joined #ceph
[13:09] * mikecao (~caobo@27.115.104.75) Quit (Read error: Connection reset by peer)
[13:09] * mikecao (~caobo@27.115.104.75) has joined #ceph
[13:11] * badone (~badone@66.187.239.16) Quit (Quit: k?thxbyebyenow)
[13:11] * karnan (~karnan@121.244.87.117) has joined #ceph
[13:11] * mikecao (~caobo@27.115.104.75) Quit (Read error: No route to host)
[13:11] * mikecao (~caobo@27.115.104.75) has joined #ceph
[13:13] * badone (~badone@66.187.239.16) has joined #ceph
[13:16] * dscastro (~dscastro@host40.181-10-63.telecom.net.ar) has joined #ceph
[13:19] * ira (~ira@c-24-34-255-34.hsd1.ma.comcast.net) has joined #ceph
[13:20] * mps (~Quackie@217.23.13.129) has joined #ceph
[13:20] * mikecao (~caobo@27.115.104.75) Quit (Ping timeout: 480 seconds)
[13:24] * ngoswami (~ngoswami@121.244.87.116) Quit (Quit: This computer has gone to sleep)
[13:25] * Aramande_ (~Rosenblut@6AGAAAFS0.tor-irc.dnsbl.oftc.net) Quit ()
[13:25] * Lite (~DougalJac@tor.piratenpartei-nrw.de) has joined #ceph
[13:28] * linuxkidd (~linuxkidd@29.sub-70-193-113.myvzw.com) has joined #ceph
[13:32] * true (~antrue@2a02:6b8:0:108:7271:bcff:fe71:43c0) has joined #ceph
[13:32] <joelio> cat/wi23
[13:32] <joelio> bah
[13:32] <true> hi!
[13:32] <joelio> /window fail
[13:32] <true> is anybody here?
[13:33] * kefu (~kefu@114.92.120.83) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[13:33] * wjw-freebsd (~wjw@vpn.ecoracks.nl) has joined #ceph
[13:35] * ibravo (~ibravo@72.83.69.64) has joined #ceph
[13:36] * zhaochao (~zhaochao@125.39.9.144) Quit (Quit: ChatZilla 0.9.92 [Firefox 45.0.1/20160318172635])
[13:37] * dugravot6 (~dugravot6@dn-infra-04.lionnois.site.univ-lorraine.fr) has joined #ceph
[13:37] * ngoswami (~ngoswami@121.244.87.116) has joined #ceph
[13:38] * kefu (~kefu@114.92.120.83) has joined #ceph
[13:45] * vikhyat (~vumrao@121.244.87.116) Quit (Remote host closed the connection)
[13:45] * vikhyat (~vumrao@121.244.87.116) has joined #ceph
[13:49] * true (~antrue@2a02:6b8:0:108:7271:bcff:fe71:43c0) Quit (Read error: Connection timed out)
[13:49] * dneary (~dneary@pool-96-237-170-97.bstnma.fios.verizon.net) Quit (Ping timeout: 480 seconds)
[13:50] * mps (~Quackie@06SAAAYU7.tor-irc.dnsbl.oftc.net) Quit ()
[13:50] * darkid (~Heliwr@91.109.29.120) has joined #ceph
[13:50] * true (~antrue@2a02:6b8:0:108:7271:bcff:fe71:43c0) has joined #ceph
[13:50] <theanalyst> true just ask, you might get a response :)
[13:52] <true> we have a trouble with incomplete pgs after an outage couple of days ago
[13:54] <true> I tried everything that I found in documentation and there is no effect...
[13:54] * georgem (~Adium@24.114.58.166) has joined #ceph
[13:54] * georgem (~Adium@24.114.58.166) Quit ()
[13:54] * georgem (~Adium@206.108.127.16) has joined #ceph
[13:55] * Lite (~DougalJac@4MJAADYXW.tor-irc.dnsbl.oftc.net) Quit ()
[13:55] * Kurimus1 (~Gecko1986@46.166.186.235) has joined #ceph
[13:59] <true> as I understood correctly ceph-objecstore-tool with --op mark-complete just recreate blank pg with received pgid.
[14:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) Quit (Remote host closed the connection)
[14:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) has joined #ceph
[14:08] * dugravot6 (~dugravot6@dn-infra-04.lionnois.site.univ-lorraine.fr) Quit (Quit: Leaving.)
[14:13] * whatevsz (~quassel@ppp-46-244-224-168.dynamic.mnet-online.de) has joined #ceph
[14:15] * IvanJobs (~hardes@103.50.11.146) Quit (Read error: Connection reset by peer)
[14:15] * wyang (~wyang@116.216.30.3) has joined #ceph
[14:19] * huangjun (~kvirc@117.151.52.171) has joined #ceph
[14:19] * EinstCrazy (~EinstCraz@180.152.103.247) has joined #ceph
[14:20] * darkid (~Heliwr@6AGAAAFVH.tor-irc.dnsbl.oftc.net) Quit ()
[14:20] * zviratko (~Peaced@46.183.218.199) has joined #ceph
[14:21] * shaunm (~shaunm@74.83.215.100) has joined #ceph
[14:21] * wyang (~wyang@116.216.30.3) Quit (Quit: This computer has gone to sleep)
[14:22] * karnan (~karnan@121.244.87.117) Quit (Remote host closed the connection)
[14:25] * Kurimus1 (~Gecko1986@06SAAAYWL.tor-irc.dnsbl.oftc.net) Quit ()
[14:25] * Blueraven (~lmg@ns316491.ip-37-187-129.eu) has joined #ceph
[14:26] * wyang (~wyang@59.45.74.43) has joined #ceph
[14:27] * rraja (~rraja@121.244.87.117) Quit (Ping timeout: 480 seconds)
[14:28] * rraja (~rraja@121.244.87.117) has joined #ceph
[14:30] * wyang (~wyang@59.45.74.43) Quit ()
[14:31] * wyang (~wyang@59.45.74.43) has joined #ceph
[14:34] * goretoxo (~psilva@62.82.24.134.static.user.ono.com) has joined #ceph
[14:36] * georgem (~Adium@206.108.127.16) Quit (Ping timeout: 480 seconds)
[14:38] * AlecTaylor (~AlecTaylo@125.253.96.20) has joined #ceph
[14:38] <AlecTaylor> hi
[14:42] * goretoxo (~psilva@62.82.24.134.static.user.ono.com) Quit (Quit: Leaving)
[14:42] * goretoxo (~psilva@62.82.24.134.static.user.ono.com) has joined #ceph
[14:47] * goretoxo (~psilva@62.82.24.134.static.user.ono.com) Quit ()
[14:47] * johnavp1989 (~jpetrini@166.170.32.14) has joined #ceph
[14:49] * gopher_49 (~gopher_49@75.66.43.16) has joined #ceph
[14:50] * zviratko (~Peaced@6AGAAAFW1.tor-irc.dnsbl.oftc.net) Quit ()
[14:50] * OODavo (~Averad@192.42.116.16) has joined #ceph
[14:51] * true (~antrue@2a02:6b8:0:108:7271:bcff:fe71:43c0) Quit (Read error: Connection timed out)
[14:53] * true (~antrue@2a02:6b8:0:108:7271:bcff:fe71:43c0) has joined #ceph
[14:54] * dneary (~dneary@nat-pool-bos-u.redhat.com) has joined #ceph
[14:55] * Blueraven (~lmg@6AGAAAFXC.tor-irc.dnsbl.oftc.net) Quit ()
[14:55] * FNugget1 (~Frostshif@06SAAAYZY.tor-irc.dnsbl.oftc.net) has joined #ceph
[14:56] * georgem (~Adium@206.108.127.16) has joined #ceph
[14:56] * AlecTaylor (~AlecTaylo@0001b36e.user.oftc.net) Quit (Quit: Leaving)
[14:59] * ibravo (~ibravo@72.83.69.64) Quit (Quit: This computer has gone to sleep)
[14:59] * johnavp1989 (~jpetrini@166.170.32.14) Quit (Ping timeout: 480 seconds)
[15:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) Quit (Remote host closed the connection)
[15:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) has joined #ceph
[15:02] * evelu (~erwan@37.164.112.0) Quit (Ping timeout: 480 seconds)
[15:02] * bara (~bara@nat-pool-brq-t.redhat.com) Quit (Ping timeout: 480 seconds)
[15:05] * gopher_49 (~gopher_49@75.66.43.16) Quit (Ping timeout: 480 seconds)
[15:07] * ngoswami (~ngoswami@121.244.87.116) Quit (Quit: This computer has gone to sleep)
[15:08] * dyasny (~dyasny@46.117.8.108) Quit (Quit: Ex-Chat)
[15:09] * brad_mssw (~brad@66.129.88.50) has joined #ceph
[15:09] * evelu (~erwan@62.147.161.106) has joined #ceph
[15:10] * dyasny (~dyasny@46-117-8-108.bb.netvision.net.il) has joined #ceph
[15:12] * wyang (~wyang@59.45.74.43) Quit (Quit: This computer has gone to sleep)
[15:14] * bara (~bara@213.175.37.12) has joined #ceph
[15:15] * wyang (~wyang@116.216.30.3) has joined #ceph
[15:15] * TMM (~hp@185.5.122.2) Quit (Ping timeout: 480 seconds)
[15:16] * TMM (~hp@185.5.122.2) has joined #ceph
[15:17] * bniver (~bniver@pool-173-48-58-27.bstnma.fios.verizon.net) Quit (Quit: Leaving)
[15:20] * OODavo (~Averad@4MJAADY17.tor-irc.dnsbl.oftc.net) Quit ()
[15:20] * EinstCrazy (~EinstCraz@180.152.103.247) Quit (Read error: Connection reset by peer)
[15:20] * mhack (~mhack@nat-pool-bos-t.redhat.com) has joined #ceph
[15:20] * bniver (~bniver@pool-173-48-58-27.bstnma.fios.verizon.net) has joined #ceph
[15:20] * dyasny (~dyasny@46-117-8-108.bb.netvision.net.il) Quit (Ping timeout: 480 seconds)
[15:22] * rdas (~rdas@121.244.87.116) has joined #ceph
[15:24] * EinstCrazy (~EinstCraz@180.152.103.247) has joined #ceph
[15:24] * bara_ (~bara@nat-pool-brq-t.redhat.com) has joined #ceph
[15:25] * FNugget1 (~Frostshif@06SAAAYZY.tor-irc.dnsbl.oftc.net) Quit ()
[15:27] * vicente (~vicente@1-163-219-137.dynamic.hinet.net) has joined #ceph
[15:29] * dyasny (~dyasny@46.117.8.108) has joined #ceph
[15:29] * bara (~bara@213.175.37.12) Quit (Ping timeout: 480 seconds)
[15:30] * kefu (~kefu@114.92.120.83) Quit (Read error: No route to host)
[15:30] * kefu (~kefu@114.92.120.83) has joined #ceph
[15:33] * gopher_49 (~gopher_49@host2.drexchem.com) has joined #ceph
[15:36] * The1w (~jens@node3.survey-it.dk) Quit (Ping timeout: 480 seconds)
[15:43] * vikhyat (~vumrao@121.244.87.116) Quit (Quit: Leaving)
[15:45] * AlecTaylor (~AlecTaylo@0001b36e.user.oftc.net) has joined #ceph
[15:45] <AlecTaylor> hi
[15:45] <AlecTaylor> Setting up my first Ceph cluster!
[15:45] <IcePic> welcome to the cult of much-diskspace.
[15:46] <AlecTaylor> muchos HD
[15:46] * TMM_ (~hp@185.5.122.2) has joined #ceph
[15:46] * TMM_ (~hp@185.5.122.2) Quit (Remote host closed the connection)
[15:46] <AlecTaylor> With this command, `ceph-deploy new {initial-monitor-node(s)}`, if I have the user+pass for connecting via SSH to each host, how do I share it in that command? - Or do I need to update the SSH config?
[15:46] * TMM_ (~hp@185.5.122.2) has joined #ceph
[15:47] * AlecTaylor could generate SSH keys and enable passwordless login on each host he supposes... rarr
[15:48] <IcePic> yes, or ssh-agent or something.
[15:49] <AlecTaylor> Mmmk
[15:49] * TMM (~hp@185.5.122.2) Quit (Ping timeout: 480 seconds)
[15:50] * haomaiwang (~haomaiwan@li745-113.members.linode.com) Quit (Ping timeout: 480 seconds)
[15:50] <AlecTaylor> BTW: My use-case is for file-upload, so will want an HTTP proxy in front (probably built into Ceph?), then will start worrying about encryption, authorization and dir+file level RBAC.
[15:50] <AlecTaylor> PS: Is Ceph overkill for my use-case?
[15:51] * Racpatel (~Racpatel@2601:87:3:3601::4edb) has joined #ceph
[15:51] <etienneme> ceph's object storage could answer your need
[15:52] * haomaiwang (~haomaiwan@li745-113.members.linode.com) has joined #ceph
[15:53] * gregmark (~Adium@68.87.42.115) has joined #ceph
[15:55] * w0lfeh (~phyphor@hessel2.torservers.net) has joined #ceph
[15:55] * bene2 (~bene@2601:18c:8501:25e4:ea2a:eaff:fe08:3c7a) has joined #ceph
[15:56] <AlecTaylor> etienneme: Mmm, thought so
[15:56] <AlecTaylor> Anyway, it's midnight here, might give this another shot in a month or so
[15:56] * AlecTaylor (~AlecTaylo@0001b36e.user.oftc.net) Quit (Quit: Leaving)
[16:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) Quit (Remote host closed the connection)
[16:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) has joined #ceph
[16:05] * mhackett (~mhack@nat-pool-bos-u.redhat.com) has joined #ceph
[16:06] * mhack (~mhack@nat-pool-bos-t.redhat.com) Quit (Ping timeout: 480 seconds)
[16:07] * xarses_ (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[16:13] * yanzheng (~zhyan@118.116.113.6) Quit (Quit: This computer has gone to sleep)
[16:19] * dugravot6 (~dugravot6@dn-infra-04.lionnois.site.univ-lorraine.fr) has joined #ceph
[16:21] * haplo37 (~haplo37@199.91.185.156) has joined #ceph
[16:25] * w0lfeh (~phyphor@4MJAADY5U.tor-irc.dnsbl.oftc.net) Quit ()
[16:25] * Curt` (~dusti@95.211.169.35) has joined #ceph
[16:30] * whatevsz (~quassel@ppp-46-244-224-168.dynamic.mnet-online.de) Quit (Ping timeout: 480 seconds)
[16:30] * haomaiwang (~haomaiwan@li745-113.members.linode.com) Quit (Remote host closed the connection)
[16:33] * karnan (~karnan@106.51.136.1) has joined #ceph
[16:34] <zenpac> How does one make a "ceph mon dump" command using the epoch?
[16:36] <Be-El> how do I list all rados gateways user?
[16:37] * ngoswami (~ngoswami@121.244.87.116) has joined #ceph
[16:37] * xarses_ (~xarses@64.124.158.100) has joined #ceph
[16:39] * wyang (~wyang@116.216.30.3) Quit (Quit: This computer has gone to sleep)
[16:39] * bjornar_ (~bjornar@ti0099a430-1561.bb.online.no) has joined #ceph
[16:40] * RameshN (~rnachimu@121.244.87.117) Quit (Ping timeout: 480 seconds)
[16:41] * wyang (~wyang@116.216.30.3) has joined #ceph
[16:42] * ibravo (~ibravo@72.198.142.104) has joined #ceph
[16:44] * Hemanth (~hkumar_@121.244.87.117) Quit (Quit: Leaving)
[16:46] * nicodemus_ (~nicodemus@186.136.9.38) has joined #ceph
[16:47] * ftuesca (~ftuesca@181.170.141.52) has joined #ceph
[16:48] <nicodemus_> morning
[16:50] <nicodemus_> I have a 5 node, 27 OSD ceph cluster running hammer, and see that four nodes have about 10Mb/s traffic while the fifth has 10 times that (about 120Mb/s)... what could be the cause?
[16:50] * Hideous (~tritonx@tor1e1.privacyfoundation.ch) has joined #ceph
[16:51] <nicodemus_> the pools have size 2, and checking random pgs for any given pool show that the acting OSDs are spread across all nodes
[16:52] <Walex> nicodemus_: it could be that the other nodes have some network problem...
[16:52] * ibravo (~ibravo@72.198.142.104) Quit (Quit: This computer has gone to sleep)
[16:53] * ibravo (~ibravo@72.198.142.104) has joined #ceph
[16:54] <nicodemus_> I've realized about this about a month ago, when I started graphing network usage... I've checked interface counters both on the cisco switch as well as the node's interfaces, but see nothing out of the ordinary
[16:54] * ircolle (~Adium@2601:285:201:2bf9:ac5f:332c:781e:e7b) has joined #ceph
[16:55] * Curt` (~dusti@06SAAAY5L.tor-irc.dnsbl.oftc.net) Quit ()
[16:58] * ngoswami (~ngoswami@121.244.87.116) Quit (Quit: Leaving)
[17:00] * analbeard (~shw@support.memset.com) Quit (Ping timeout: 480 seconds)
[17:03] * wushudoin (~wushudoin@2601:646:8201:7769:2ab2:bdff:fe0b:a6ee) has joined #ceph
[17:08] * mhack (~mhack@nat-pool-bos-t.redhat.com) has joined #ceph
[17:12] * Bartek (~Bartek@dynamic-81-168-143-180.ssp.dialog.net.pl) has joined #ceph
[17:14] * mhackett (~mhack@nat-pool-bos-u.redhat.com) Quit (Ping timeout: 480 seconds)
[17:15] * dgurtner_ (~dgurtner@87.215.61.26) has joined #ceph
[17:15] * vicente (~vicente@1-163-219-137.dynamic.hinet.net) Quit (Ping timeout: 480 seconds)
[17:15] * vbellur (~vijay@2601:18f:700:55b0:5e51:4fff:fee8:6a5c) Quit (Ping timeout: 480 seconds)
[17:16] * dgurtner (~dgurtner@82.199.64.68) Quit (Ping timeout: 480 seconds)
[17:19] * goretoxo (~psilva@62.82.24.134.static.user.ono.com) has joined #ceph
[17:20] * Hideous (~tritonx@4MJAADY8B.tor-irc.dnsbl.oftc.net) Quit ()
[17:20] * FNugget (~Linkshot@65.19.167.132) has joined #ceph
[17:20] * haomaiwang (~haomaiwan@li745-113.members.linode.com) has joined #ceph
[17:21] * dscastro (~dscastro@host40.181-10-63.telecom.net.ar) Quit (Ping timeout: 480 seconds)
[17:24] * dyasny (~dyasny@46.117.8.108) Quit (Ping timeout: 480 seconds)
[17:24] * dugravot6 (~dugravot6@dn-infra-04.lionnois.site.univ-lorraine.fr) Quit (Quit: Leaving.)
[17:25] * djidis__ (~DJComet@94.242.228.107) has joined #ceph
[17:27] * Miouge (~Miouge@h-72-233.a163.priv.bahnhof.se) has joined #ceph
[17:30] * joshd1 (~jdurgin@68-119-140-18.dhcp.ahvl.nc.charter.com) has joined #ceph
[17:31] * shyu (~shyu@111.201.66.83) has joined #ceph
[17:31] * dgurtner (~dgurtner@82.199.64.68) has joined #ceph
[17:31] * huangjun (~kvirc@117.151.52.171) Quit (Ping timeout: 480 seconds)
[17:32] * whatevsz (~quassel@ppp-46-244-224-168.dynamic.mnet-online.de) has joined #ceph
[17:33] * dgurtner_ (~dgurtner@87.215.61.26) Quit (Ping timeout: 480 seconds)
[17:35] * ozzzo|2 (~kvirc@216.223.13.166) has joined #ceph
[17:37] * LDA (~lda@host217-114-156-249.pppoe.mark-itt.net) has joined #ceph
[17:37] * sudocat (~dibarra@192.185.1.20) has joined #ceph
[17:41] * rraja (~rraja@121.244.87.117) Quit (Quit: Leaving)
[17:43] * Bartek (~Bartek@dynamic-81-168-143-180.ssp.dialog.net.pl) Quit (Ping timeout: 480 seconds)
[17:43] <Be-El> does rados gateway support AWS4 authentication?
[17:50] * FNugget (~Linkshot@4MJAADY93.tor-irc.dnsbl.oftc.net) Quit ()
[17:50] * csoukup (~csoukup@159.140.254.102) has joined #ceph
[17:52] * zaitcev (~zaitcev@c-50-130-189-82.hsd1.nm.comcast.net) has joined #ceph
[17:52] * ade (~abradshaw@212.77.58.61) Quit (Ping timeout: 480 seconds)
[17:53] * jowilkin (~jowilkin@2601:644:4000:b0bf:ea2a:eaff:fe08:3f1d) Quit (Ping timeout: 480 seconds)
[17:54] * dscastro (~dscastro@host40.181-10-63.telecom.net.ar) has joined #ceph
[17:55] * djidis__ (~DJComet@6AGAAAGAF.tor-irc.dnsbl.oftc.net) Quit ()
[18:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) Quit (Remote host closed the connection)
[18:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) has joined #ceph
[18:01] * bara_ (~bara@nat-pool-brq-t.redhat.com) Quit (Ping timeout: 480 seconds)
[18:02] * DV_ (~veillard@2001:41d0:a:f29f::1) Quit (Ping timeout: 480 seconds)
[18:03] * Bartek (~Bartek@dynamic-81-168-143-180.ssp.dialog.net.pl) has joined #ceph
[18:05] * karnan (~karnan@106.51.136.1) Quit (Quit: Leaving)
[18:05] * jowilkin (~jowilkin@c-50-148-138-174.hsd1.ca.comcast.net) has joined #ceph
[18:08] * vicente (~vicente@1-163-219-137.dynamic.hinet.net) has joined #ceph
[18:09] * lxo (~aoliva@lxo.user.oftc.net) Quit (Ping timeout: 480 seconds)
[18:09] * olid19811115 (~olid1982@aftr-88-217-181-40.dynamic.mnet-online.de) has joined #ceph
[18:09] * swami2 (~swami@49.32.0.124) Quit (Quit: Leaving.)
[18:12] * wyang (~wyang@116.216.30.3) Quit (Quit: This computer has gone to sleep)
[18:13] * bara_ (~bara@213.175.37.12) has joined #ceph
[18:15] * kefu is now known as kefu|afk
[18:15] * ircolle (~Adium@2601:285:201:2bf9:ac5f:332c:781e:e7b) Quit (Quit: Leaving.)
[18:16] * vicente (~vicente@1-163-219-137.dynamic.hinet.net) Quit (Ping timeout: 480 seconds)
[18:17] * linjan__ (~linjan@86.62.112.22) Quit (Ping timeout: 480 seconds)
[18:18] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[18:18] * ircolle (~Adium@c-71-229-136-109.hsd1.co.comcast.net) has joined #ceph
[18:19] * wjw-freebsd (~wjw@vpn.ecoracks.nl) Quit (Ping timeout: 480 seconds)
[18:19] * overclk_ (~quassel@117.202.104.176) has joined #ceph
[18:20] * anadrom (~Wizeon@95.211.169.35) has joined #ceph
[18:21] * shyu (~shyu@111.201.66.83) Quit (Ping timeout: 480 seconds)
[18:22] * overclk (~quassel@117.202.104.75) Quit (Ping timeout: 480 seconds)
[18:23] * kefu|afk (~kefu@114.92.120.83) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[18:25] * Izanagi (~W|ldCraze@justus.impium.de) has joined #ceph
[18:26] * TMM_ (~hp@185.5.122.2) Quit (Quit: Ex-Chat)
[18:27] * krypto (~krypto@G68-90-105-232.sbcis.sbc.com) has joined #ceph
[18:27] * kefu (~kefu@183.193.163.144) has joined #ceph
[18:27] * dgurtner (~dgurtner@82.199.64.68) Quit (Ping timeout: 480 seconds)
[18:29] * linjan__ (~linjan@86.62.112.22) has joined #ceph
[18:32] * Be-El (~blinke@nat-router.computational.bio.uni-giessen.de) Quit (Quit: Leaving.)
[18:36] * kefu_ (~kefu@114.92.120.83) has joined #ceph
[18:36] * Bartek (~Bartek@dynamic-81-168-143-180.ssp.dialog.net.pl) Quit (Ping timeout: 480 seconds)
[18:39] * Bartek (~Bartek@dynamic-81-168-143-180.ssp.dialog.net.pl) has joined #ceph
[18:40] * vasu (~vasu@c-73-231-60-138.hsd1.ca.comcast.net) has joined #ceph
[18:43] * kefu (~kefu@183.193.163.144) Quit (Ping timeout: 480 seconds)
[18:44] * sjackson (~sjackson@207.111.246.196) has joined #ceph
[18:46] * goretoxo (~psilva@62.82.24.134.static.user.ono.com) Quit (Remote host closed the connection)
[18:50] * anadrom (~Wizeon@4MJAADZC1.tor-irc.dnsbl.oftc.net) Quit ()
[18:50] * Arfed (~Doodlepie@chomsky.torservers.net) has joined #ceph
[18:54] * jordanP (~jordan@204.13-14-84.ripe.coltfrance.com) Quit (Quit: Leaving)
[18:55] * mattbenjamin1 (~mbenjamin@aa2.linuxbox.com) has joined #ceph
[18:55] * Izanagi (~W|ldCraze@6AGAAAGEA.tor-irc.dnsbl.oftc.net) Quit ()
[18:55] * branto (~branto@ip-78-102-208-181.net.upcbroadband.cz) Quit (Quit: Leaving.)
[18:57] * true (~antrue@2a02:6b8:0:108:7271:bcff:fe71:43c0) Quit (Read error: Connection timed out)
[18:57] * wwdillingham (~LobsterRo@140.247.242.44) has joined #ceph
[18:58] <wwdillingham> Can I have multiple cephfs filesystems ontop of the same data and metadata pool?
[18:58] * Geph (~Geoffrey@41.77.153.99) Quit (Ping timeout: 480 seconds)
[18:59] * true (~antrue@2a02:6b8:0:108:7271:bcff:fe71:43c0) has joined #ceph
[19:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) Quit (Remote host closed the connection)
[19:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) has joined #ceph
[19:01] * joshd1 (~jdurgin@68-119-140-18.dhcp.ahvl.nc.charter.com) Quit (Quit: Leaving.)
[19:03] * dgurtner (~dgurtner@217.149.140.193) has joined #ceph
[19:03] * overclk (~quassel@117.202.100.254) has joined #ceph
[19:03] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:246c:eb77:7876:1701) Quit (Ping timeout: 480 seconds)
[19:05] * wjw-freebsd (~wjw@smtp.digiware.nl) has joined #ceph
[19:06] * Kupo1 (~tyler.wil@23.111.254.159) has joined #ceph
[19:06] * overclk_ (~quassel@117.202.104.176) Quit (Ping timeout: 480 seconds)
[19:08] * bdeetz (~bdeetz@72.194.132.130) has left #ceph
[19:08] * ircolle (~Adium@c-71-229-136-109.hsd1.co.comcast.net) Quit (Quit: Leaving.)
[19:08] * vicente (~vicente@1-163-219-137.dynamic.hinet.net) has joined #ceph
[19:11] * rakeshgm (~rakesh@106.51.225.4) has joined #ceph
[19:11] * nwf (~nwf@00018577.user.oftc.net) Quit (Read error: No route to host)
[19:11] * EinstCrazy (~EinstCraz@180.152.103.247) Quit (Remote host closed the connection)
[19:12] * EinstCrazy (~EinstCraz@180.152.103.247) has joined #ceph
[19:14] <sjackson> Hello all. My ceph cluster changed it's FSID after doing a ceph-deploy mon create. Was wondering if someone could help me?
[19:15] * kefu_ (~kefu@114.92.120.83) Quit (Ping timeout: 480 seconds)
[19:15] * hroussea (~hroussea@000200d7.user.oftc.net) Quit (Ping timeout: 480 seconds)
[19:16] * rdas (~rdas@121.244.87.116) Quit (Quit: Leaving)
[19:17] * vicente (~vicente@1-163-219-137.dynamic.hinet.net) Quit (Ping timeout: 480 seconds)
[19:18] <olid19811115> hi sjackson, you can only repeat that, modifying the ceph-deploy script to use your original FSID
[19:18] * overclk (~quassel@117.202.100.254) Quit (Remote host closed the connection)
[19:20] * Arfed (~Doodlepie@06SAAAZC2.tor-irc.dnsbl.oftc.net) Quit ()
[19:20] * EinstCrazy (~EinstCraz@180.152.103.247) Quit (Ping timeout: 480 seconds)
[19:21] <sjackson> when you say modify the ceph-deply script, do you mean the ceph.conf file?
[19:21] * efirs (~firs@c-50-185-70-125.hsd1.ca.comcast.net) has joined #ceph
[19:22] * bearkitten (~bearkitte@cpe-76-172-86-115.socal.res.rr.com) Quit (Quit: WeeChat 1.4)
[19:22] * thomnico (~thomnico@132-110.80-90.static-ip.oleane.fr) has joined #ceph
[19:23] * wwdillingham (~LobsterRo@140.247.242.44) Quit (Quit: wwdillingham)
[19:24] * Catsceo (~SaneSmith@94.242.228.107) has joined #ceph
[19:24] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:60fc:c21d:c1c6:96e4) has joined #ceph
[19:25] * QuantumBeep (~murmur@93.115.95.206) has joined #ceph
[19:33] * karnan (~karnan@106.51.136.1) has joined #ceph
[19:33] * bara_ (~bara@213.175.37.12) Quit (Quit: Bye guys! (??????????????????? ?????????)
[19:33] * karnan (~karnan@106.51.136.1) Quit ()
[19:37] * swami1 (~swami@27.7.172.84) has joined #ceph
[19:39] * wjw-freebsd (~wjw@smtp.digiware.nl) Quit (Quit: Nettalk6 - www.ntalk.de)
[19:40] * germano (~germano@default-46-102-197-194.interdsl.co.uk) has joined #ceph
[19:40] * true (~antrue@2a02:6b8:0:108:7271:bcff:fe71:43c0) has left #ceph
[19:45] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:60fc:c21d:c1c6:96e4) Quit (Ping timeout: 480 seconds)
[19:46] * shylesh__ (~shylesh@59.95.71.203) has joined #ceph
[19:46] * krypto (~krypto@G68-90-105-232.sbcis.sbc.com) Quit (Quit: Leaving)
[19:46] * krypto (~krypto@G68-90-105-232.sbcis.sbc.com) has joined #ceph
[19:47] * bearkitten (~bearkitte@cpe-76-172-86-115.socal.res.rr.com) has joined #ceph
[19:47] * thomnico (~thomnico@132-110.80-90.static-ip.oleane.fr) Quit (Quit: Ex-Chat)
[19:48] * thomnico (~thomnico@132-110.80-90.static-ip.oleane.fr) has joined #ceph
[19:51] * wwdillingham (~LobsterRo@140.247.242.44) has joined #ceph
[19:51] * krypto (~krypto@G68-90-105-232.sbcis.sbc.com) Quit (Read error: Connection reset by peer)
[19:51] * krypto (~krypto@103.252.26.130) has joined #ceph
[19:52] * krypto (~krypto@103.252.26.130) Quit ()
[19:54] * Bartek (~Bartek@dynamic-81-168-143-180.ssp.dialog.net.pl) Quit (Ping timeout: 480 seconds)
[19:54] * Catsceo (~SaneSmith@4MJAADZGJ.tor-irc.dnsbl.oftc.net) Quit ()
[19:54] * Joppe4899 (~KapiteinK@192.87.28.82) has joined #ceph
[19:55] * bearkitten (~bearkitte@cpe-76-172-86-115.socal.res.rr.com) Quit (Quit: WeeChat 1.4)
[19:55] * QuantumBeep (~murmur@06SAAAZE0.tor-irc.dnsbl.oftc.net) Quit ()
[19:55] * neobenedict (~MonkeyJam@185.100.85.132) has joined #ceph
[19:56] * swami1 (~swami@27.7.172.84) Quit (Quit: Leaving.)
[19:56] * bearkitten (~bearkitte@cpe-76-172-86-115.socal.res.rr.com) has joined #ceph
[20:00] * georgem1 (~Adium@206.108.127.16) has joined #ceph
[20:00] * georgem (~Adium@206.108.127.16) Quit (Read error: Connection reset by peer)
[20:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) Quit (Remote host closed the connection)
[20:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) has joined #ceph
[20:01] * darthbacon (~Jason@129.24.240.130) has joined #ceph
[20:03] * georgem (~Adium@206.108.127.16) has joined #ceph
[20:03] * georgem1 (~Adium@206.108.127.16) Quit (Read error: Connection reset by peer)
[20:04] * georgem1 (~Adium@206.108.127.16) has joined #ceph
[20:04] * georgem (~Adium@206.108.127.16) Quit (Read error: Connection reset by peer)
[20:05] * Hemanth (~hkumar_@103.228.221.160) has joined #ceph
[20:07] * Concubidated (~cube@c-50-173-245-118.hsd1.ca.comcast.net) has joined #ceph
[20:10] * vicente (~vicente@1-163-219-137.dynamic.hinet.net) has joined #ceph
[20:13] * linjan__ (~linjan@86.62.112.22) Quit (Ping timeout: 480 seconds)
[20:15] * haomaiwang (~haomaiwan@li745-113.members.linode.com) Quit (Ping timeout: 480 seconds)
[20:17] * darthbacon (~Jason@129.24.240.130) has left #ceph
[20:18] * nicodemus_ (~nicodemus@186.136.9.38) Quit (Quit: Leaving)
[20:18] * vicente (~vicente@1-163-219-137.dynamic.hinet.net) Quit (Ping timeout: 480 seconds)
[20:19] * dyasny (~dyasny@46.117.8.108) has joined #ceph
[20:24] * thomnico (~thomnico@132-110.80-90.static-ip.oleane.fr) Quit (Ping timeout: 480 seconds)
[20:24] * Joppe4899 (~KapiteinK@4MJAADZHZ.tor-irc.dnsbl.oftc.net) Quit ()
[20:24] * verbalins (~AluAlu@192.42.115.101) has joined #ceph
[20:25] * kawa2014 (~kawa@89.184.114.246) Quit (Quit: Leaving)
[20:25] * neobenedict (~MonkeyJam@6AGAAAGJF.tor-irc.dnsbl.oftc.net) Quit ()
[20:29] * dgurtner (~dgurtner@217.149.140.193) Quit (Ping timeout: 480 seconds)
[20:30] * `Jin (~Frymaster@217.23.14.190) has joined #ceph
[20:31] * Bartek (~Bartek@dynamic-81-168-143-180.ssp.dialog.net.pl) has joined #ceph
[20:33] * evelu (~erwan@62.147.161.106) Quit (Ping timeout: 480 seconds)
[20:37] * wwdillingham_ (~LobsterRo@65.112.8.196) has joined #ceph
[20:37] * derjohn_mob (~aj@fw.gkh-setu.de) Quit (Ping timeout: 480 seconds)
[20:39] * shylesh__ (~shylesh@59.95.71.203) Quit (Remote host closed the connection)
[20:40] * thomnico (~thomnico@132-110.80-90.static-ip.oleane.fr) has joined #ceph
[20:41] * wwdillingham (~LobsterRo@140.247.242.44) Quit (Ping timeout: 480 seconds)
[20:41] * wwdillingham_ is now known as wwdillingham
[20:41] * Discovery (~Discovery@178.239.49.69) has joined #ceph
[20:42] * efirs (~firs@c-50-185-70-125.hsd1.ca.comcast.net) Quit (Quit: Leaving.)
[20:44] * ftuesca (~ftuesca@181.170.141.52) Quit (Quit: Leaving)
[20:45] * bdeetz (~bdeetz@72.194.132.130) has joined #ceph
[20:46] <m0zes> wwdillingham: no.
[20:47] <m0zes> wwdillingham: why? you can't even have multiple cephfs filesystems in the same cluster until jewel, and even that is experimental.
[20:48] <wwdillingham> I dont have a reason to just wanted to understand the relationship of the fs to the pools....
[20:48] <lookcrabs> Is it possible to modify a radosgw user name?
[20:49] <lookcrabs> the uid part?
[20:49] <m0zes> okay, fair enough. you can have multiple data pools within a cephfs filesystem. the initial metadata and data pools are special, though.
[20:49] <wwdillingham> m0zes: I noticed that but cant see how additional data pools are added.
[20:50] <m0zes> ceph mds add_data_pool $pool
[20:50] <wwdillingham> m0zes: so I cant have multiple filesystems (each with their own data/metadata pools) in infernalis?
[20:50] <m0zes> no. not in infernalis.
[20:50] <m0zes> http://docs.ceph.com/docs/master/cephfs/file-layouts/ is how you tell ceph what pool to put the cephfs files in.
[20:52] * `Jin (~Frymaster@4MJAADZJW.tor-irc.dnsbl.oftc.net) Quit (Ping timeout: 480 seconds)
[20:54] * TMM (~hp@178-84-46-106.dynamic.upc.nl) has joined #ceph
[20:54] * verbalins (~AluAlu@4MJAADZJK.tor-irc.dnsbl.oftc.net) Quit ()
[21:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) has joined #ceph
[21:05] * davidzlap1 (~Adium@cpe-172-91-154-245.socal.res.rr.com) has joined #ceph
[21:08] * Razva (~Razva@5-15-50-22.residential.rdsnet.ro) has joined #ceph
[21:08] <Razva> hey! is there any Ceph GUI, like SwiftStack for Swift?
[21:10] <Anticimex> hmm, how do i debug ceph clients talking with mon?
[21:10] <Anticimex> i'm just using e.g. "rados --id '$keyid' lspools" to test that a client key works
[21:11] * davidzlap (~Adium@2605:e000:1313:8003:95fa:9f0e:dd9e:a6d4) Quit (Ping timeout: 480 seconds)
[21:11] * vicente (~vicente@1-163-219-137.dynamic.hinet.net) has joined #ceph
[21:11] <Anticimex> very confusing that clients from one rack suddenly can't talk properly with the monitors, given other racks with identical config can :s
[21:12] <Anticimex> rados' doesn't have debug functionality, it appears. i imagine it'd be useful to just look at what messages are communicated in either case, and compare
[21:12] * angdraug (~angdraug@64.124.158.100) has joined #ceph
[21:14] * Razva^ (~Razva@5-15-50-22.residential.rdsnet.ro) has joined #ceph
[21:14] * Razva (~Razva@00021622.user.oftc.net) Quit (Read error: Connection reset by peer)
[21:14] <lookcrabs> Razva: can you elaborate? You mean like an S3 frontend/gui? You could try bucket explorer or something in that case
[21:14] <lookcrabs> Razva^: Otherwise not that I know of
[21:15] * Razva^ is now known as Razva
[21:16] <Razva> lookcrabs I'm talking about a GUI that will allow me to easely add new nodes, monitor existing ones, monitor hard-drives etc
[21:16] * singh (~oftc-webi@pat.hitachigst.com) has joined #ceph
[21:16] * rendar (~I@host189-116-dynamic.53-82-r.retail.telecomitalia.it) Quit (Ping timeout: 480 seconds)
[21:19] * wwdillingham (~LobsterRo@65.112.8.196) Quit (Quit: wwdillingham)
[21:19] <singh> Hi, does somebody know how can I run multiple rados client on a single machine with each instance of rados client attached to different network interfaces?
[21:19] * vicente (~vicente@1-163-219-137.dynamic.hinet.net) Quit (Ping timeout: 480 seconds)
[21:19] * rendar (~I@host189-116-dynamic.53-82-r.retail.telecomitalia.it) has joined #ceph
[21:23] * singh (~oftc-webi@pat.hitachigst.com) Quit (Quit: Page closed)
[21:23] * wwdillingham (~LobsterRo@65.112.8.196) has joined #ceph
[21:24] <Anticimex> ok, mtu issue
[21:24] * legion (~nastidon@tor1e1.privacyfoundation.ch) has joined #ceph
[21:24] <Anticimex> weird. though fixed
[21:25] * TomasCZ (~TomasCZ@yes.tenlab.net) has joined #ceph
[21:25] <m0zes> mtu issues? shouldn't mtu probing be enabled?
[21:27] <Anticimex> yeah, tcp should not negotiate something it can't pass
[21:27] <Anticimex> the tcp connection to mon got established and data flowed
[21:28] <Anticimex> i guess firewall dropped icmp from router
[21:28] <Anticimex> it was a "backbone" link that was misconfigured
[21:28] <Anticimex> hmm, or not, because there is no firewall
[21:28] <Anticimex> out of ideas
[21:29] <diq> TCP doesn't know what can and can't pass through intermediate firewalls
[21:29] <diq> not when setting up the connection
[21:29] <TMM> I have a question: I have a cluster of 29 physical boxes with 8 OSDs each, each OSD is a 1TB SSD. The OSD machines are 48 core boxes and they have a ton of ram, connected with 2x 10GB. But whenever a rebuild is happening I get a bunch of slow requests impacting the rbd clients. I have max backfills set to 1, and max recovery threads to 1 also.
[21:29] <TMM> I have implemented the stack size fix for tcmalloc and it seems a little better but it's still happening
[21:29] * georgem1 (~Adium@206.108.127.16) Quit (Read error: Connection reset by peer)
[21:29] <TMM> is there anything more I can do to improve this?
[21:30] * georgem (~Adium@206.108.127.16) has joined #ceph
[21:30] <diq> yikes that sounds broken.
[21:31] <TMM> yeah, agreed :P
[21:31] <diq> what's your backfill set to?
[21:31] <diq> 1?
[21:31] <TMM> yeah
[21:31] * ircolle (~Adium@c-71-229-136-109.hsd1.co.comcast.net) has joined #ceph
[21:31] <diq> backfill and recovery at 1 should be....minimal impact
[21:31] <diq> which version?
[21:31] <TMM> hammer
[21:32] <TMM> hammer on centos7
[21:32] <diq> network saturated?
[21:32] * Concubidated (~cube@c-50-173-245-118.hsd1.ca.comcast.net) Quit (Quit: Leaving.)
[21:32] <TMM> no
[21:32] <m0zes> question, size and min_size settings on the pools?
[21:32] <TMM> I checked, we get like 3 gbit per osd during recovery
[21:32] <TMM> which is well below saturation
[21:33] <TMM> the osds are in two racks with 160gbit connections between racks
[21:33] * davidzlap1 (~Adium@cpe-172-91-154-245.socal.res.rr.com) Quit (Quit: Leaving.)
[21:33] <TMM> but rebuilds mostly stay inside racks anyway
[21:33] <TMM> my crushmap is configured to only pick nodes that belong to the pool in each rack
[21:34] * ircolle1 (~Adium@2601:285:201:2bf9:c7e:39a4:eedd:431f) has joined #ceph
[21:34] <m0zes> TMM: size and min_size of the pool(s)?
[21:34] <TMM> m0zes, sorry
[21:34] * allaok (~allaok@ARennes-658-1-126-166.w83-199.abo.wanadoo.fr) has joined #ceph
[21:35] <TMM> m0zes, how exactly do I get that info?
[21:35] <m0zes> ceph osd pool ls detail
[21:35] <TMM> oh, sorry, size is 3 min size is 2
[21:35] <ozzzo|2> I'm reading http://docs.ceph.com/docs/master/radosgw/federated-config/ which briefly discusses geographically distributed clusters, and says "this isn?t recommended"
[21:36] <ozzzo|2> is anyone doing this? has anyone seen it work?
[21:36] * davidzlap (~Adium@cpe-172-91-154-245.socal.res.rr.com) has joined #ceph
[21:36] <m0zes> well, there goes that idea out the window.
[21:36] <TMM> this is the full output of ls detail : http://paste.debian.net/424366/
[21:37] <TMM> so, size 10 minsize 7, I thought you meant the ceph.conf osd sizes
[21:38] <TMM> for the erasure coded pools
[21:38] * linjan__ (~linjan@176.193.197.8) has joined #ceph
[21:38] <TMM> min size 2 size 3 for distributed pools
[21:39] <TMM> I can also paste my crush map if that's helpful?
[21:39] * ircolle (~Adium@c-71-229-136-109.hsd1.co.comcast.net) Quit (Ping timeout: 480 seconds)
[21:39] * dyasny (~dyasny@46.117.8.108) Quit (Ping timeout: 480 seconds)
[21:40] <m0zes> it might, but I'm not seeing anything obvious...
[21:41] <TMM> http://paste.debian.net/424367/
[21:41] <TMM> I've left off all the buckets, it's just 30x hosts the way you'd expect
[21:42] <diq> that's a really low number of PG's
[21:42] <TMM> and ceph.conf http://paste.debian.net/424368/
[21:42] <TMM> diq, too few PGs you think?
[21:43] <diq> isn't it like 100 PG's per OSD, then round up to next power of 2?
[21:43] * Hemanth (~hkumar_@103.228.221.160) Quit (Quit: Leaving)
[21:43] <diq> I think it's different for EC
[21:43] <m0zes> http://ceph.com/pgcalc/
[21:43] <diq> but for replicated I read that was the reco
[21:44] <TMM> I currently have 33 pgs per OSD I guess
[21:44] <diq> yeah that tool is kinda henky
[21:44] <diq> I just do it by hand
[21:44] <TMM> is that's what's causing my issues?
[21:44] <diq> possibly
[21:44] <TMM> can I fix this?
[21:44] <diq> keep in mind that you can increase the number of pg's and pgp's
[21:44] <diq> but you cannot decrease
[21:45] <TMM> I vaguely remember having an issue with ceph complaining I had too many pgs
[21:45] <diq> and increasing will definitely increase load while it places objects
[21:46] <TMM> ah, you mean during the 'reshaping'?
[21:46] <diq> yeah
[21:46] <TMM> can I increase it slowly?
[21:46] <diq> it will say that X out of Y objects are misplaced
[21:46] <diq> you can use the backfill and recovery knobs
[21:47] <diq> it sounds like you have a fair amount of hardware headroom though
[21:47] <TMM> yeah
[21:47] <diq> depending on your cluster size, I'd start it at slow time and crank it up high. Just go for the quick rip.
[21:48] <TMM> the osds are also hypervisors though, but they are very lightly loaded at the moment
[21:48] <TMM> average system load of 2.0 :P
[21:48] <TMM> ok, so I should have 23200 pgs then? 29*8*100
[21:48] <diq> next power of 2
[21:49] <TMM> 128 then?
[21:49] <TMM> so about 2000 pgs per pool?
[21:49] <diq> 32768 would be the next power of 2 above 23200
[21:50] <TMM> oh, I misunderstood
[21:50] <TMM> I thought next power of 2 above 100 per osd
[21:50] <TMM> so more like 2700 pgs per pool
[21:50] <TMM> do I need to configure something on my osds to let them have more pgs?
[21:51] <diq> I guess I haven't really done much with EC
[21:51] <diq> EC pools
[21:51] <m0zes> no
[21:51] <diq> you change the pool settings with the ceph command
[21:51] <m0zes> divide by replicas
[21:51] <TMM> well, even my replicated pools have only 512 pgs
[21:51] <m0zes> or k+m in the case of ec
[21:52] <TMM> ok, so... for replicated pools it's 2700/3=900 pgs per pool?
[21:52] * davidzlap (~Adium@cpe-172-91-154-245.socal.res.rr.com) Quit (Quit: Leaving.)
[21:52] <m0zes> no
[21:52] <m0zes> ((100 or 200) * osds * %data / size) where size #replicas or k+m
[21:52] <TMM> %data?
[21:52] <m0zes> how much of the storage that pool will hold.
[21:53] <TMM> ah, that's kind of hard to tell
[21:53] <TMM> I know only how much the cache pools will be, roughly
[21:53] <TMM> I have no idea what the ratio of image vs volume storage is going to be
[21:54] <m0zes> I estimated. if you're off by a bit, it won't matter that much. you could always assume they're equal and it will be close...
[21:54] * legion (~nastidon@6AGAAAGOT.tor-irc.dnsbl.oftc.net) Quit ()
[21:54] * dougf (~dougf@96-38-99-179.dhcp.jcsn.tn.charter.com) Quit (Ping timeout: 480 seconds)
[21:55] * Malcovent (~Neon@tor00.telenet.unc.edu) has joined #ceph
[21:55] <TMM> ok, so the amsz1 and amsz2 pools are essentially confined to 15 OSDs
[21:55] * davidzlap (~Adium@cpe-172-91-154-245.socal.res.rr.com) has joined #ceph
[21:55] <TMM> so I should not calculate the total over all my OSDs then for those pools, should I?
[21:55] <TMM> err
[21:55] <TMM> 15 hosts
[21:55] <TMM> 120 osds
[21:56] <TMM> the 'add pool' button doesn't appear to be working in pgcalc :P
[22:00] * Silentkillzr (~Miho@4MJAADZND.tor-irc.dnsbl.oftc.net) has joined #ceph
[22:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) Quit (Remote host closed the connection)
[22:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) has joined #ceph
[22:03] * BrianA (~BrianA@12.236.17.11) has joined #ceph
[22:03] <m0zes> yeah, I think pgcalc is funky. choose openstack w RGW, and repurpose the existing pools. deleting the extras.
[22:05] * vbellur (~vijay@71.234.224.255) has joined #ceph
[22:07] <TMM> I just did the calculations using redhat's tool
[22:07] <TMM> and it is suggesting the pg counts that I actually have :-/
[22:09] * Silentkillzr (~Miho@4MJAADZND.tor-irc.dnsbl.oftc.net) Quit (Remote host closed the connection)
[22:09] <TMM> https://tmm.cx/~hp/rhel_pgcalc.png
[22:09] * csoukup (~csoukup@159.140.254.102) Quit (Ping timeout: 480 seconds)
[22:10] <TMM> it's 128 osds per pool, not 100 though
[22:11] * vicente (~vicente@1-163-219-137.dynamic.hinet.net) has joined #ceph
[22:13] <TMM> with 116 osds it's still 512 pgs per pool :-/
[22:13] <TMM> did I do my %data calculation wrong you think?
[22:13] <TMM> my cluster isn't very full yet, there's only about 50TB used in total out of 200
[22:13] * Yopi (~rcfighter@tor.thd.ninja) has joined #ceph
[22:14] <m0zes> I'd call that about right.
[22:14] <TMM> ok, so I shouldn't increase my pgs per pool then?
[22:14] <m0zes> I wouldn't. I'm not sure what is going on with your cluster.
[22:15] <TMM> diq thought I had way too few pgs
[22:15] * Concubidated (~cube@c-50-173-245-118.hsd1.ca.comcast.net) has joined #ceph
[22:16] <TMM> I see between about 1000 - 20000 op/s on my cluster generally
[22:16] <TMM> if that has any bearing on anything
[22:17] * jclm (~jclm@ip68-96-198-45.lv.lv.cox.net) has joined #ceph
[22:17] * ibravo (~ibravo@72.198.142.104) Quit (Quit: This computer has gone to sleep)
[22:19] <TMM> what I don't understand is, if I divide my number of placement groups by my number of osds I get 33, not anything close to 300
[22:19] <TMM> pgmap v10138010: 7680 pgs, 12 pools, 26233 GB data, 14158 kobjects
[22:19] * dgurtner (~dgurtner@217.149.140.193) has joined #ceph
[22:19] * vicente (~vicente@1-163-219-137.dynamic.hinet.net) Quit (Ping timeout: 480 seconds)
[22:20] <m0zes> right, but those placement groups touch multiple osds each.
[22:20] <TMM> ah, so how do I go from number of pgs to number of pgs per osd?
[22:21] <m0zes> infernalis?
[22:21] <TMM> hammer
[22:22] <TMM> I could upgrade to infernalis though
[22:22] <TMM> I'm mostly on hammer because that was stable when I installed the cluster
[22:22] <m0zes> infernalis has some erasure code performance improvements. I don't know of an easy way to get per osd pg counts in hammer.
[22:22] <TMM> I backported the systemd support from infernails to hammer though :)
[22:24] <TMM> I assume that in-place upgrades from hammer to infernalis aren't a big deal?
[22:24] * Malcovent (~Neon@6AGAAAGP2.tor-irc.dnsbl.oftc.net) Quit ()
[22:25] <m0zes> https://ceph.com/releases/v9-2-0-infernalis-released/
[22:25] <m0zes> there are some notes on upgrading from hammer.
[22:26] <diq> TMM, I thought you had more than 100 OSD's
[22:27] <diq> you have 232, no?
[22:27] <TMM> diq, I have 232, but most of my pools are confined to individual racks that only have 15 physical hosts each in them
[22:27] <TMM> so that's 116 osds per rack
[22:28] <diq> OK. You might want to redo your calculations then. You used 100 OSDs in the PNG you posted
[22:29] <TMM> yeah, when I fill in 116 the pg nums stay the same
[22:29] <TMM> only the number of pgs for the 'images' pool which is spread across both racks doubles
[22:29] <TMM> I guess I could increase those
[22:30] <TMM> so, what is the correct procedure for upgrading a ceph cluster? monitors first or last? does it matter?
[22:30] <diq> follow whatever the notes for that release say
[22:30] <TMM> it doesn't say anything about that
[22:30] * Cassiopaya (~Discovery@ip-176-199-137-160.hsi06.unitymediagroup.de) has joined #ceph
[22:30] <diq> it'll tell you about ugprading between versions
[22:31] <TMM> yeah, but it doesn't say in what order the components should be upgraded
[22:31] * Discovery (~Discovery@178.239.49.69) Quit (Ping timeout: 480 seconds)
[22:33] <TMM> regardless, I don't think that's what causing my slow requests, right?
[22:34] * Tumm (~brannmar@digi00810.digicube.fr) has joined #ceph
[22:36] <TMM> although I did still have issues with one host having the wrong tcmalloc settings at the time, and that one host had a load of 50 during the last rebuild. I suppose that that last slow request stuff I saw could just be that one hypervisor
[22:36] <TMM> but I would expect that if a request takes too long the client would fail to another osd
[22:37] <TMM> does that not happen?
[22:37] * Cory1 (77fc11a3@107.161.19.53) has joined #ceph
[22:38] * valeech (~valeech@pool-108-44-162-111.clppva.fios.verizon.net) has joined #ceph
[22:43] * georgem (~Adium@206.108.127.16) Quit (Quit: Leaving.)
[22:43] * Yopi (~rcfighter@6AGAAAGQ7.tor-irc.dnsbl.oftc.net) Quit ()
[22:43] * hassifa (~Zyn@193.107.85.56) has joined #ceph
[22:46] * Bartek (~Bartek@dynamic-81-168-143-180.ssp.dialog.net.pl) Quit (Ping timeout: 480 seconds)
[22:47] * dscastro (~dscastro@host40.181-10-63.telecom.net.ar) Quit (Ping timeout: 480 seconds)
[22:51] <Razva> guys, is Calamari still developed? like...RH bought it, ok. but is there any free version of it? the github is ancient.
[23:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) Quit (Remote host closed the connection)
[23:01] * wwdillingham (~LobsterRo@65.112.8.196) Quit (Quit: wwdillingham)
[23:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) has joined #ceph
[23:01] * LDA (~lda@host217-114-156-249.pppoe.mark-itt.net) Quit (Quit: LDA)
[23:03] * Tumm (~brannmar@06SAAAZNW.tor-irc.dnsbl.oftc.net) Quit ()
[23:03] * Knuckx (~Nephyrin@195.22.126.119) has joined #ceph
[23:04] * valeech (~valeech@pool-108-44-162-111.clppva.fios.verizon.net) Quit (Quit: valeech)
[23:08] * wak (~oftc-webi@104.132.1.103) has joined #ceph
[23:08] * wak is now known as wak__
[23:08] <wak__> ls
[23:09] * wak__ (~oftc-webi@104.132.1.103) Quit ()
[23:09] * Miouge (~Miouge@h-72-233.a163.priv.bahnhof.se) Quit (Quit: Miouge)
[23:10] * haplo37 (~haplo37@199.91.185.156) Quit (Remote host closed the connection)
[23:12] * vicente (~vicente@1-163-219-137.dynamic.hinet.net) has joined #ceph
[23:13] * hassifa (~Zyn@6AGAAAGS6.tor-irc.dnsbl.oftc.net) Quit ()
[23:13] * SaneSmith (~HoboPickl@tor.les.net) has joined #ceph
[23:14] * gregmark (~Adium@68.87.42.115) Quit (Quit: Leaving.)
[23:16] * Bartek (~Bartek@dynamic-81-168-143-180.ssp.dialog.net.pl) has joined #ceph
[23:19] * Concubidated (~cube@c-50-173-245-118.hsd1.ca.comcast.net) Quit (Quit: Leaving.)
[23:20] * vicente (~vicente@1-163-219-137.dynamic.hinet.net) Quit (Ping timeout: 480 seconds)
[23:21] * wjw-freebsd (~wjw@smtp.digiware.nl) has joined #ceph
[23:21] * allaok (~allaok@ARennes-658-1-126-166.w83-199.abo.wanadoo.fr) Quit (Quit: Leaving.)
[23:24] * derjohn_mob (~aj@p578b6aa1.dip0.t-ipconnect.de) has joined #ceph
[23:28] * BrianA (~BrianA@12.236.17.11) Quit (Read error: Connection reset by peer)
[23:33] * Knuckx (~Nephyrin@06SAAAZO8.tor-irc.dnsbl.oftc.net) Quit ()
[23:33] * Architect (~Xylios@06SAAAZQE.tor-irc.dnsbl.oftc.net) has joined #ceph
[23:34] * Bartek (~Bartek@dynamic-81-168-143-180.ssp.dialog.net.pl) Quit (Ping timeout: 480 seconds)
[23:34] * brad_mssw (~brad@66.129.88.50) Quit (Quit: Leaving)
[23:39] * Cassiopaya (~Discovery@ip-176-199-137-160.hsi06.unitymediagroup.de) Quit (Read error: Connection reset by peer)
[23:42] * gopher_49 (~gopher_49@host2.drexchem.com) Quit (Ping timeout: 480 seconds)
[23:43] * SaneSmith (~HoboPickl@4MJAADZQI.tor-irc.dnsbl.oftc.net) Quit ()
[23:43] * Kwen (~Sliker@exit1.ipredator.se) has joined #ceph
[23:45] * angdraug (~angdraug@64.124.158.100) Quit (Quit: Leaving)

These logs were automatically created by CephLogBot on irc.oftc.net using the Java IRC LogBot.