#ceph IRC Log

Index

IRC Log for 2016-10-18

Timestamps are in GMT/BST.

[0:00] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) has joined #ceph
[0:09] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) Quit (Ping timeout: 480 seconds)
[0:21] * davidzlap (~Adium@2605:e000:1313:8003:f0a9:4ad5:cd0e:5002) Quit (Quit: Leaving.)
[0:22] * wes_dillingham (~wes_dilli@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) has joined #ceph
[0:22] * wes_dillingham (~wes_dilli@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) Quit ()
[0:22] * chrisinajar (~Scymex@tor-exit.squirrel.theremailer.net) Quit ()
[0:23] * davidzlap (~Adium@2605:e000:1313:8003:f0a9:4ad5:cd0e:5002) has joined #ceph
[0:27] * dneary (~dneary@nat-pool-bos-u.redhat.com) Quit (Ping timeout: 480 seconds)
[0:28] * mitchty_ (~quassel@130-245-47-212.rev.cloud.scaleway.com) Quit (Remote host closed the connection)
[0:28] * mitchty (~quassel@130-245-47-212.rev.cloud.scaleway.com) has joined #ceph
[0:30] * winmutt (~rolfmarti@c-73-184-237-230.hsd1.ga.comcast.net) Quit (Ping timeout: 480 seconds)
[0:37] * niknakpaddywak (~xander.ni@outbound.lax.demandmedia.com) has joined #ceph
[0:39] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:2cc7:a486:5bd1:230e) Quit (Ping timeout: 480 seconds)
[0:40] * winmutt (~rolfmarti@c-73-184-237-230.hsd1.ga.comcast.net) has joined #ceph
[0:40] * vata1 (~vata@207.96.182.162) Quit (Quit: Leaving.)
[0:41] * ronrib (~oftc-webi@2400:8c80::505:45cd:67ce:9431:20e1) has joined #ceph
[0:43] * kuku (~kuku@203.177.235.23) has joined #ceph
[0:52] * wak-work (~wak-work@2620:15c:2c5:3:58a2:eedc:3ac4:707e) Quit (Ping timeout: 480 seconds)
[0:55] * kuku (~kuku@203.177.235.23) Quit (Quit: computer sleep)
[1:00] * wak-work (~wak-work@2620:15c:2c5:3:358c:bc6f:1702:49c) has joined #ceph
[1:03] * johnavp1989 (~jpetrini@pool-100-14-10-2.phlapa.fios.verizon.net) has joined #ceph
[1:03] <- *johnavp1989* To prove that you are human, please enter the result of 8+3
[1:06] * stiopa (~stiopa@cpc73832-dals21-2-0-cust453.20-2.cable.virginm.net) Quit (Ping timeout: 480 seconds)
[1:07] * ircolle (~Adium@2601:285:201:633a:6481:9b0b:4fbd:947a) Quit (Quit: Leaving.)
[1:09] * dalgaaf (uid15138@id-15138.ealing.irccloud.com) Quit (Quit: Connection closed for inactivity)
[1:11] * oms101 (~oms101@p20030057EA4FDD00C6D987FFFE4339A1.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[1:13] * winmutt (~rolfmarti@c-73-184-237-230.hsd1.ga.comcast.net) Quit (Ping timeout: 480 seconds)
[1:20] * oms101 (~oms101@p20030057EA448700C6D987FFFE4339A1.dip0.t-ipconnect.de) has joined #ceph
[1:21] * diver (~diver@cpe-98-26-71-226.nc.res.rr.com) has joined #ceph
[1:21] * diver_ (~diver@cpe-2606-A000-111B-C12B-60E4-A3B0-754C-97A2.dyn6.twc.com) has joined #ceph
[1:22] * squizzi (~squizzi@107.13.237.240) Quit (Quit: bye)
[1:27] * sudocat (~dibarra@192.185.1.20) Quit (Ping timeout: 480 seconds)
[1:29] * diver (~diver@cpe-98-26-71-226.nc.res.rr.com) Quit (Ping timeout: 480 seconds)
[1:32] * wushudoin (~wushudoin@2601:646:8200:c9f0:2ab2:bdff:fe0b:a6ee) Quit (Quit: Leaving)
[1:33] * ira (~ira@c-24-34-255-34.hsd1.ma.comcast.net) Quit (Remote host closed the connection)
[1:36] * dgurtner (~dgurtner@c-217-115-42-158.cust.bredband2.com) Quit (Ping timeout: 480 seconds)
[1:43] * Unai (~Adium@50-115-70-150.static-ip.telepacific.net) Quit (Ping timeout: 480 seconds)
[1:46] * doppelgrau (~doppelgra@88.72.94.200) Quit (Quit: doppelgrau)
[1:52] * xarses (~xarses@64.124.158.3) Quit (Ping timeout: 480 seconds)
[1:58] * Skaag (~lunix@65.200.54.234) Quit (Quit: Leaving.)
[2:05] * ffilzwin (~ffilz@107-1-123-195-ip-static.hfc.comcastbusiness.net) has joined #ceph
[2:11] * xarses (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) has joined #ceph
[2:33] * mhack (~mhack@24-151-36-149.dhcp.nwtn.ct.charter.com) Quit (Remote host closed the connection)
[2:36] * truh (~jakob@2a02:8388:8300:4f00:3ea9:f4ff:fe65:1448) Quit (Ping timeout: 480 seconds)
[2:40] * georgem (~Adium@45.72.230.218) has joined #ceph
[2:47] * husain (~oftc-webi@2601:647:c803:b050:d4d2:4b45:2115:f6c3) Quit (Remote host closed the connection)
[2:52] * johnavp1989 (~jpetrini@pool-100-14-10-2.phlapa.fios.verizon.net) Quit (Ping timeout: 480 seconds)
[3:03] * davidzlap (~Adium@2605:e000:1313:8003:f0a9:4ad5:cd0e:5002) Quit (Quit: Leaving.)
[3:05] * vasu (~vasu@c-73-231-60-138.hsd1.ca.comcast.net) Quit (Quit: Leaving)
[3:06] * davidzlap (~Adium@2605:e000:1313:8003:f0a9:4ad5:cd0e:5002) has joined #ceph
[3:13] * KindOne (kindone@0001a7db.user.oftc.net) has joined #ceph
[3:16] * salwasser (~Adium@72.246.3.14) Quit (Quit: Leaving.)
[3:17] * Arfed (~dicko@tsn85-159-236-219.dyn.nltelcom.net) has joined #ceph
[3:17] * adamcrume (~quassel@2601:647:cb01:f890:5c97:28ff:50d8:1c8f) has joined #ceph
[3:29] * Nicho1as (~nicho1as@00022427.user.oftc.net) has joined #ceph
[3:32] * adamcrume (~quassel@2601:647:cb01:f890:5c97:28ff:50d8:1c8f) Quit (Remote host closed the connection)
[3:35] * LiftedKilt (~LiftedKil@is.in.the.madhacker.biz) Quit (Quit: Kilted Southern)
[3:37] * salwasser (~Adium@2601:197:800:6ea1:8dee:e805:1d6f:658c) has joined #ceph
[3:39] * LiftedKilt (~LiftedKil@dragons.have.mostlyincorrect.info) has joined #ceph
[3:44] * winmutt (~rolfmarti@c-73-184-237-230.hsd1.ga.comcast.net) has joined #ceph
[3:47] * Arfed (~dicko@tsn85-159-236-219.dyn.nltelcom.net) Quit ()
[3:48] * vicente (~~vicente@125.227.238.55) has joined #ceph
[3:51] * davidzlap (~Adium@2605:e000:1313:8003:f0a9:4ad5:cd0e:5002) Quit (Quit: Leaving.)
[3:53] * jfaj (~jan@p20030084AD2699006AF728FFFE6777FF.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[4:02] * jfaj (~jan@p20030084AD2EA0006AF728FFFE6777FF.dip0.t-ipconnect.de) has joined #ceph
[4:04] * winmutt (~rolfmarti@c-73-184-237-230.hsd1.ga.comcast.net) Quit (Ping timeout: 480 seconds)
[4:05] * yanzheng (~zhyan@125.70.22.217) has joined #ceph
[4:10] * salwasser (~Adium@2601:197:800:6ea1:8dee:e805:1d6f:658c) Quit (Quit: Leaving.)
[4:10] * salwasser (~Adium@2601:197:800:6ea1:8dee:e805:1d6f:658c) has joined #ceph
[4:11] * salwasser (~Adium@2601:197:800:6ea1:8dee:e805:1d6f:658c) Quit ()
[4:16] * davidzlap (~Adium@2605:e000:1313:8003:f0a9:4ad5:cd0e:5002) has joined #ceph
[4:29] * sudocat (~dibarra@104-188-116-197.lightspeed.hstntx.sbcglobal.net) has joined #ceph
[4:39] * sudocat (~dibarra@104-188-116-197.lightspeed.hstntx.sbcglobal.net) Quit (Ping timeout: 480 seconds)
[4:40] * davidzlap (~Adium@2605:e000:1313:8003:f0a9:4ad5:cd0e:5002) Quit (Quit: Leaving.)
[4:48] * Skaag (~lunix@cpe-172-91-77-84.socal.res.rr.com) has joined #ceph
[4:50] * sudocat (~dibarra@2602:306:8bc7:4c50:613b:127:527:bc8) has joined #ceph
[4:51] * sudocat (~dibarra@2602:306:8bc7:4c50:613b:127:527:bc8) has left #ceph
[4:51] * sudocat (~dibarra@2602:306:8bc7:4c50:613b:127:527:bc8) has joined #ceph
[4:55] * georgem (~Adium@45.72.230.218) Quit (Quit: Leaving.)
[5:03] * ledgr (~ledgr@88-222-11-185.meganet.lt) has joined #ceph
[5:11] * ledgr (~ledgr@88-222-11-185.meganet.lt) Quit (Ping timeout: 480 seconds)
[5:18] * wjw-freebsd (~wjw@smtp.digiware.nl) Quit (Ping timeout: 480 seconds)
[5:22] * DominikH (~Dominik_H@176.52.196.130.suec-dacor.de) has joined #ceph
[5:28] * Dominik_H (~Dominik_H@176.52.196.248.suec-dacor.de) Quit (Ping timeout: 480 seconds)
[5:30] * Skaag (~lunix@cpe-172-91-77-84.socal.res.rr.com) Quit (Quit: Leaving.)
[5:33] * Vacuum_ (~Vacuum@88.130.207.128) has joined #ceph
[5:38] * diver_ (~diver@cpe-2606-A000-111B-C12B-60E4-A3B0-754C-97A2.dyn6.twc.com) Quit (Remote host closed the connection)
[5:39] * diver (~diver@cpe-2606-A000-111B-C12B-60E4-A3B0-754C-97A2.dyn6.twc.com) has joined #ceph
[5:39] * diver (~diver@cpe-2606-A000-111B-C12B-60E4-A3B0-754C-97A2.dyn6.twc.com) Quit (Remote host closed the connection)
[5:39] * diver (~diver@cpe-2606-A000-111B-C12B-60E4-A3B0-754C-97A2.dyn6.twc.com) has joined #ceph
[5:39] * diver (~diver@cpe-2606-A000-111B-C12B-60E4-A3B0-754C-97A2.dyn6.twc.com) Quit (Remote host closed the connection)
[5:39] * diver (~diver@cpe-98-26-71-226.nc.res.rr.com) has joined #ceph
[5:40] * diver_ (~diver@cpe-2606-A000-111B-C12B-60E4-A3B0-754C-97A2.dyn6.twc.com) has joined #ceph
[5:40] * diver_ (~diver@cpe-2606-A000-111B-C12B-60E4-A3B0-754C-97A2.dyn6.twc.com) Quit (Remote host closed the connection)
[5:40] * Vacuum__ (~Vacuum@88.130.215.192) Quit (Ping timeout: 480 seconds)
[5:40] * diver_ (~diver@cpe-2606-A000-111B-C12B-60E4-A3B0-754C-97A2.dyn6.twc.com) has joined #ceph
[5:41] * diver_ (~diver@cpe-2606-A000-111B-C12B-60E4-A3B0-754C-97A2.dyn6.twc.com) Quit (Remote host closed the connection)
[5:41] * diver_ (~diver@cpe-2606-A000-111B-C12B-60E4-A3B0-754C-97A2.dyn6.twc.com) has joined #ceph
[5:42] * diver_ (~diver@cpe-2606-A000-111B-C12B-60E4-A3B0-754C-97A2.dyn6.twc.com) Quit (Remote host closed the connection)
[5:42] * diver_ (~diver@cpe-2606-A000-111B-C12B-60E4-A3B0-754C-97A2.dyn6.twc.com) has joined #ceph
[5:47] * diver (~diver@cpe-98-26-71-226.nc.res.rr.com) Quit (Ping timeout: 480 seconds)
[5:50] * diver_ (~diver@cpe-2606-A000-111B-C12B-60E4-A3B0-754C-97A2.dyn6.twc.com) Quit (Ping timeout: 480 seconds)
[6:06] * IcePic (~jj@2001:6b0:5:1688:d4a3:d779:daa0:6904) Quit (Remote host closed the connection)
[6:06] * IcePic (~jj@c66.it.su.se) has joined #ceph
[6:08] * yanzheng (~zhyan@125.70.22.217) Quit (Ping timeout: 480 seconds)
[6:09] * yanzheng (~zhyan@125.70.22.217) has joined #ceph
[6:21] * ashah (~ashah@125.16.34.66) has joined #ceph
[6:43] * Quackie (~Pommesgab@onyx.ip-eend.nl) has joined #ceph
[6:45] * Nicho1as (~nicho1as@00022427.user.oftc.net) Quit (Quit: A man from the Far East; using WeeChat 1.5)
[6:45] * bbert (~bbert@cpe-158-222-221-208.nyc.res.rr.com) Quit (Ping timeout: 480 seconds)
[6:47] * Nicho1as (~nicho1as@00022427.user.oftc.net) has joined #ceph
[6:52] * KindOne (kindone@0001a7db.user.oftc.net) Quit (Ping timeout: 480 seconds)
[6:54] * rdas (~rdas@125.16.200.50) has joined #ceph
[6:58] * vata (~vata@96.127.202.136) Quit (Quit: Leaving.)
[6:59] * KindOne (kindone@0001a7db.user.oftc.net) has joined #ceph
[7:04] * ledgr (~ledgr@88-222-11-185.meganet.lt) has joined #ceph
[7:12] * ledgr (~ledgr@88-222-11-185.meganet.lt) Quit (Ping timeout: 480 seconds)
[7:12] * TomasCZ (~TomasCZ@yes.tenlab.net) Quit (Quit: Leaving)
[7:13] * Quackie (~Pommesgab@onyx.ip-eend.nl) Quit ()
[7:19] * madkiss1 (~madkiss@2a02:8109:8680:2000:3458:8ac2:1fbb:4e31) has joined #ceph
[7:23] * wer (~wer@216.197.66.124) Quit (Ping timeout: 480 seconds)
[7:25] * madkiss (~madkiss@vpn142.sys11.net) Quit (Ping timeout: 480 seconds)
[7:43] * diver (~diver@cpe-2606-A000-111B-C12B-A9BD-52D2-B04E-BD7B.dyn6.twc.com) has joined #ceph
[7:43] * wer (~wer@216.197.66.124) has joined #ceph
[7:43] * rakeshgm (~rakesh@125.16.34.66) has joined #ceph
[7:45] * Skaag (~lunix@cpe-172-91-77-84.socal.res.rr.com) has joined #ceph
[7:46] * trololo (~cypher@fra06-3-78-243-232-119.fbx.proxad.net) has joined #ceph
[7:47] * vimal (~vikumar@125.16.200.50) has joined #ceph
[7:51] * diver (~diver@cpe-2606-A000-111B-C12B-A9BD-52D2-B04E-BD7B.dyn6.twc.com) Quit (Ping timeout: 480 seconds)
[7:51] * wer (~wer@216.197.66.124) Quit (Ping timeout: 480 seconds)
[7:52] * karnan (~karnan@125.16.34.66) has joined #ceph
[7:59] * karnan_ (~karnan@125.16.34.66) has joined #ceph
[8:06] * karnan_ (~karnan@125.16.34.66) Quit (Quit: Leaving)
[8:07] * Be-El (~blinke@nat-router.computational.bio.uni-giessen.de) has joined #ceph
[8:13] * Ramakrishnan (~ramakrish@125.16.34.66) has joined #ceph
[8:48] * derjohn_mob (~aj@p578b6aa1.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[8:49] * Skaag (~lunix@cpe-172-91-77-84.socal.res.rr.com) Quit (Quit: Leaving.)
[8:52] * efirs (~firs@98.207.153.155) Quit (Quit: Leaving.)
[8:53] * derjohn_mob (~aj@p578b6aa1.dip0.t-ipconnect.de) has joined #ceph
[9:00] <sickology> is there a reason why radosgw (civetweb) or ceph object storage would cap client speed on 200KB/s
[9:00] <sickology> i have a client who filling his buckets, but each connection is constant at 202.67KB/s
[9:01] <sickology> any pointers where should i look?
[9:01] * dgurtner (~dgurtner@sessfw99-sesbfw99-88.ericsson.net) has joined #ceph
[9:01] * Skaag (~lunix@cpe-172-91-77-84.socal.res.rr.com) has joined #ceph
[9:02] * tdb_ (~tdb@myrtle.kent.ac.uk) has joined #ceph
[9:03] * ivve (~zed@cust-gw-11.se.zetup.net) has joined #ceph
[9:03] * tdb (~tdb@129.12.3.176) Quit (Ping timeout: 480 seconds)
[9:05] * ledgr (~ledgr@88-222-11-185.meganet.lt) has joined #ceph
[9:06] <IcePic> is the user remote, in terms on network? Perhaps some tcp window thing that makes the max allowed outstanding packets limit the speed to that "fixed" amount.
[9:06] <IcePic> I guess you already checked stuff like IO contention on ceph nodes and cpu and network-not-maxed-out and so on.
[9:08] <sickology> hm, network is not maxed for sure, cpu could be a problem, it is virtually constant at 75%
[9:10] * Ramakrishnan (~ramakrish@125.16.34.66) Quit (Ping timeout: 480 seconds)
[9:10] * rakeshgm (~rakesh@125.16.34.66) Quit (Ping timeout: 480 seconds)
[9:11] * Ramakrishnan (~ramakrish@125.16.34.66) has joined #ceph
[9:11] * Ramakrishnan (~ramakrish@125.16.34.66) Quit (Remote host closed the connection)
[9:12] * Ramakrishnan (~ramakrish@125.16.34.66) has joined #ceph
[9:13] * ledgr (~ledgr@88-222-11-185.meganet.lt) Quit (Ping timeout: 480 seconds)
[9:15] * DominikH (~Dominik_H@176.52.196.130.suec-dacor.de) Quit (Ping timeout: 480 seconds)
[9:16] * rakeshgm (~rakesh@125.16.34.66) has joined #ceph
[9:16] * gila (~gila@5ED4FE92.cm-7-5d.dynamic.ziggo.nl) Quit (Quit: Textual IRC Client: www.textualapp.com)
[9:17] * analbeard (~shw@support.memset.com) has joined #ceph
[9:17] * gila (~gila@5ED4FE92.cm-7-5d.dynamic.ziggo.nl) has joined #ceph
[9:19] * wer (~wer@216.197.66.124) has joined #ceph
[9:20] * T1w (~jens@node3.survey-it.dk) has joined #ceph
[9:21] * Dominik_H (~Dominik_H@176.52.196.57.suec-dacor.de) has joined #ceph
[9:24] * derjohn_mob (~aj@p578b6aa1.dip0.t-ipconnect.de) Quit (Remote host closed the connection)
[9:28] * Skaag (~lunix@cpe-172-91-77-84.socal.res.rr.com) Quit (Quit: Leaving.)
[9:31] * fsimonce (~simon@95.239.69.67) has joined #ceph
[9:38] * Hemanth (~hkumar_@125.16.34.66) has joined #ceph
[9:38] * Dominik_H (~Dominik_H@176.52.196.57.suec-dacor.de) Quit (Ping timeout: 480 seconds)
[9:43] * derjohn_mob (~aj@46.189.28.33) has joined #ceph
[9:44] * diver (~diver@cpe-2606-A000-111B-C12B-A9BD-52D2-B04E-BD7B.dyn6.twc.com) has joined #ceph
[9:50] * truh (~jakob@2a02:8388:8300:4f00:3ea9:f4ff:fe65:1448) has joined #ceph
[9:50] * wer (~wer@216.197.66.124) Quit (Ping timeout: 480 seconds)
[9:52] * diver (~diver@cpe-2606-A000-111B-C12B-A9BD-52D2-B04E-BD7B.dyn6.twc.com) Quit (Ping timeout: 480 seconds)
[9:53] * wer (~wer@216.197.66.124) has joined #ceph
[9:54] * TMM (~hp@dhcp-077-248-009-229.chello.nl) Quit (Quit: Ex-Chat)
[9:57] * atheism (~atheism@182.48.117.114) Quit (Remote host closed the connection)
[9:57] * atheism (~atheism@182.48.117.114) has joined #ceph
[10:05] <IcePic> do you see similar results when testing locally?
[10:11] * rraja (~rraja@125.16.34.66) has joined #ceph
[10:12] * bitserker (~toni@88.87.194.130) has joined #ceph
[10:12] * topro (~prousa@p578af414.dip0.t-ipconnect.de) Quit (Remote host closed the connection)
[10:18] * topro (~prousa@p578af414.dip0.t-ipconnect.de) has joined #ceph
[10:18] * nardial (~ls@p5DC0723A.dip0.t-ipconnect.de) has joined #ceph
[10:18] * tdb (~tdb@129.12.3.176) has joined #ceph
[10:20] * nardial (~ls@p5DC0723A.dip0.t-ipconnect.de) Quit ()
[10:21] * doppelgrau (~doppelgra@dslb-088-072-094-200.088.072.pools.vodafone-ip.de) has joined #ceph
[10:21] * tdb_ (~tdb@myrtle.kent.ac.uk) Quit (Ping timeout: 480 seconds)
[10:26] * Ramakrishnan (~ramakrish@125.16.34.66) Quit (Ping timeout: 480 seconds)
[10:36] * Ramakrishnan (~ramakrish@125.16.34.66) has joined #ceph
[10:41] * Nicho1as (~nicho1as@00022427.user.oftc.net) Quit (Quit: A man from the Far East; using WeeChat 1.5)
[10:42] * hbogert (~Adium@95.170.93.16) has joined #ceph
[10:43] * TMM (~hp@185.5.121.201) has joined #ceph
[10:45] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:2cc7:a486:5bd1:230e) has joined #ceph
[10:52] * derjohn_mob (~aj@46.189.28.33) Quit (Ping timeout: 480 seconds)
[10:54] * ade (~abradshaw@188.29.165.216.threembb.co.uk) has joined #ceph
[10:54] * hbogert (~Adium@95.170.93.16) Quit (Read error: Connection reset by peer)
[10:55] * hbogert (~Adium@95.170.93.16) has joined #ceph
[10:57] * Vacuum__ (~Vacuum@i59F797B9.versanet.de) has joined #ceph
[10:59] * zhen (~Thunderbi@130.57.30.250) has joined #ceph
[11:00] * zhen (~Thunderbi@130.57.30.250) Quit ()
[11:02] * derjohn_mob (~aj@46.189.28.89) has joined #ceph
[11:04] * Vacuum_ (~Vacuum@88.130.207.128) Quit (Ping timeout: 480 seconds)
[11:06] * rmart04 (~rmart04@support.memset.com) has joined #ceph
[11:10] * bitserker (~toni@88.87.194.130) Quit (Ping timeout: 480 seconds)
[11:14] * Vacuum_ (~Vacuum@88.130.205.74) has joined #ceph
[11:21] * Vacuum__ (~Vacuum@i59F797B9.versanet.de) Quit (Ping timeout: 480 seconds)
[11:22] * ade (~abradshaw@188.29.165.216.threembb.co.uk) Quit (Quit: Too sexy for his shirt)
[11:23] * bitserker (~toni@88.87.194.130) has joined #ceph
[11:26] * ade (~abradshaw@188.29.165.216.threembb.co.uk) has joined #ceph
[11:26] * doppelgrau (~doppelgra@dslb-088-072-094-200.088.072.pools.vodafone-ip.de) Quit (Quit: doppelgrau)
[11:28] * AlbertR (~iushakov@188.94.225.106) has joined #ceph
[11:28] * ivve (~zed@cust-gw-11.se.zetup.net) Quit (Ping timeout: 480 seconds)
[11:28] <AlbertR> Hi
[11:30] * storage (~Atomizer@31.185.27.1) has joined #ceph
[11:33] <AlbertR> Who can help me? I refused several the OSD, after their replacement, I had 2 PG status incomplete. I can not recover them in the log pg written "peering_blocked_by_detail": [ { "detail": "peering_blocked_by_history_les_bound" }
[11:44] * nardial (~ls@p5DC0723A.dip0.t-ipconnect.de) has joined #ceph
[11:47] * rotbeard (~redbeard@185.32.80.238) has joined #ceph
[11:48] * bitserker (~toni@88.87.194.130) Quit (Ping timeout: 480 seconds)
[11:49] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) has joined #ceph
[11:51] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) Quit (Remote host closed the connection)
[11:51] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) has joined #ceph
[11:53] * truh (~jakob@2a02:8388:8300:4f00:3ea9:f4ff:fe65:1448) Quit (Ping timeout: 480 seconds)
[11:54] <AlbertR> No one knows?
[11:55] <peetaur2> AlbertR: pastebin ceph pg dump_stuck
[11:56] <peetaur2> and then also ceph pg <pgid> query for each stuck
[11:59] * storage (~Atomizer@31.185.27.1) Quit ()
[12:00] * derjohn_mob (~aj@46.189.28.89) Quit (Ping timeout: 480 seconds)
[12:00] * bitserker (~toni@88.87.194.130) has joined #ceph
[12:01] * moegyver (~oftc-webi@2001:9b0:14a:10:36e6:d7ff:fe0e:81b0) has joined #ceph
[12:05] <AlbertR> peetaur2: http://pastebin.com/QqPzHZiw
[12:08] * doppelgrau (~doppelgra@132.252.235.172) has joined #ceph
[12:10] * derjohn_mob (~aj@46.189.28.57) has joined #ceph
[12:13] <AlbertR> peetaur2, Can I ever fully remove these pg even data lost?
[12:15] <sadziu> you export them, mark them as complete, and reimport them using ceph-objectstore-tool
[12:15] <sadziu> *you can
[12:15] * valeech (~valeech@pool-96-247-203-33.clppva.fios.verizon.net) Quit (Quit: valeech)
[12:15] <sadziu> but that should be last resort
[12:22] <AlbertR> sadziu, I did export, then flush journal, then ceph-objectstore-tool ... --op remove, after restarting osd incomplete pg left. They are something blocks.
[12:25] * truh (~jakob@195.245.225.251) has joined #ceph
[12:31] <peetaur2> AlbertR: maybe setting "osd_find_best_info_ignore_history_les = true" however you do that would fix it like mentioned in https://github.com/ceph/ceph/pull/8156
[12:44] * [0x4A6F]_ (~ident@p4FC26ECB.dip0.t-ipconnect.de) has joined #ceph
[12:47] <AlbertR> peetaur2, I'm going to try now
[12:47] * [0x4A6F] (~ident@0x4a6f.user.oftc.net) Quit (Ping timeout: 480 seconds)
[12:47] * [0x4A6F]_ is now known as [0x4A6F]
[12:55] * karnan (~karnan@125.16.34.66) Quit (Ping timeout: 480 seconds)
[12:55] <AlbertR> peetaur2, Thanks, it helped, pgs moved into recovery status
[13:00] * vicente (~~vicente@125.227.238.55) Quit (Quit: Leaving)
[13:01] * ivve (~zed@cust-gw-11.se.zetup.net) has joined #ceph
[13:01] * fandi (~fandi@202.158.9.161) has joined #ceph
[13:03] * T1w (~jens@node3.survey-it.dk) Quit (Ping timeout: 480 seconds)
[13:12] <peetaur2> great :)
[13:20] * madkiss1 (~madkiss@2a02:8109:8680:2000:3458:8ac2:1fbb:4e31) Quit (Quit: Leaving.)
[13:20] * fandi__ (~fandi@202.158.9.166) has joined #ceph
[13:22] * diver (~diver@cpe-2606-A000-111B-C12B-E528-1E32-25C3-9BF0.dyn6.twc.com) has joined #ceph
[13:28] * fandi (~fandi@202.158.9.161) Quit (Ping timeout: 480 seconds)
[13:30] * diver (~diver@cpe-2606-A000-111B-C12B-E528-1E32-25C3-9BF0.dyn6.twc.com) Quit (Ping timeout: 480 seconds)
[13:30] * ashah (~ashah@125.16.34.66) Quit (Quit: Leaving)
[13:31] * rwheeler (~rwheeler@pool-108-7-196-31.bstnma.fios.verizon.net) Quit (Quit: Leaving)
[13:33] * nardial (~ls@p5DC0723A.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[13:33] * truh (~jakob@195.245.225.251) Quit (Remote host closed the connection)
[13:41] * bagir (~bagir@85.26.168.125) has joined #ceph
[13:42] * jarrpa (~jarrpa@63.225.131.166) has joined #ceph
[13:42] * salwasser (~Adium@c-73-219-86-22.hsd1.ma.comcast.net) has joined #ceph
[13:45] * salwasser (~Adium@c-73-219-86-22.hsd1.ma.comcast.net) Quit ()
[13:48] * valeech (~valeech@50-242-253-97-static.hfc.comcastbusiness.net) has joined #ceph
[13:52] * bniver (~bniver@71-9-144-29.static.oxfr.ma.charter.com) has joined #ceph
[13:54] * hbogert (~Adium@95.170.93.16) Quit (Quit: Leaving.)
[14:02] * Racpatel (~Racpatel@2601:87:3:31e3::3840) has joined #ceph
[14:03] * diver (~diver@216.85.162.34) has joined #ceph
[14:04] * diver_ (~diver@95.85.8.93) has joined #ceph
[14:04] * rakeshgm (~rakesh@125.16.34.66) Quit (Ping timeout: 480 seconds)
[14:07] * Racpatel (~Racpatel@2601:87:3:31e3::3840) Quit ()
[14:08] * Racpatel (~Racpatel@2601:87:3:31e3::3840) has joined #ceph
[14:08] * ffilzwin (~ffilz@107-1-123-195-ip-static.hfc.comcastbusiness.net) Quit (Quit: Leaving)
[14:11] * diver (~diver@216.85.162.34) Quit (Ping timeout: 480 seconds)
[14:13] * diver (~diver@216.85.162.34) has joined #ceph
[14:14] * sankarshan (~sankarsha@125.16.34.66) has joined #ceph
[14:14] * jwandborg (~Corneliou@91.108.183.42) has joined #ceph
[14:16] * Miouge (~Miouge@109.129.187.163) has joined #ceph
[14:16] * Ramakrishnan (~ramakrish@125.16.34.66) Quit (Ping timeout: 480 seconds)
[14:16] <Miouge> How do you estimate the write penaility of EC?
[14:17] * rakeshgm (~rakesh@125.16.34.66) has joined #ceph
[14:19] * nardial (~ls@p5DC0723A.dip0.t-ipconnect.de) has joined #ceph
[14:20] * diver_ (~diver@95.85.8.93) Quit (Ping timeout: 480 seconds)
[14:20] <Miouge> For replicated pool I do: aggregate writes/(2R) for colocated journals. But in the case of EC should one do: aggregate writes*K/(K+M) ?
[14:20] <Miouge> s/K/(K+M)/K/(2K+2M)
[14:26] * Ramakrishnan (~ramakrish@125.16.34.66) has joined #ceph
[14:26] * The_Ball (~pi@20.92-221-43.customer.lyse.net) Quit (Read error: Connection reset by peer)
[14:26] * georgem (~Adium@206.108.127.16) has joined #ceph
[14:26] * hbogert (~Adium@95.170.93.16) has joined #ceph
[14:30] * Nicho1as (~nicho1as@00022427.user.oftc.net) has joined #ceph
[14:32] * Ramakrishnan (~ramakrish@125.16.34.66) Quit (Quit: Leaving)
[14:32] * sankarshan (~sankarsha@125.16.34.66) Quit (Quit: Are you sure you want to quit this channel (Cancel/Ok) ?)
[14:32] * Ramakrishnan (~ramakrish@125.16.34.66) has joined #ceph
[14:35] * jwandborg (~Corneliou@91.108.183.42) Quit (Ping timeout: 480 seconds)
[14:36] * The_Ball (~pi@20.92-221-43.customer.lyse.net) has joined #ceph
[14:39] * winmutt (~rolfmarti@199.33.145.32) has joined #ceph
[14:40] * bene2 (~bene@2601:193:4101:f410:ea2a:eaff:fe08:3c7a) has joined #ceph
[14:44] * ffilz (~ffilz@66.187.232.65) has joined #ceph
[14:46] * diver_ (~diver@95.85.8.93) has joined #ceph
[14:47] * rmart04_ (~rmart04@5.153.255.226) has joined #ceph
[14:49] * yanzheng (~zhyan@125.70.22.217) Quit (Quit: This computer has gone to sleep)
[14:49] * GooseYArd (~GooseYArd@ec2-52-5-245-183.compute-1.amazonaws.com) Quit (Quit: leaving)
[14:51] * vbellur (~vijay@2601:18f:700:55b0:5e51:4fff:fee8:6a5c) Quit (Ping timeout: 480 seconds)
[14:52] * rmart04 (~rmart04@support.memset.com) Quit (Ping timeout: 480 seconds)
[14:52] * rmart04_ is now known as rmart04
[14:53] * diver (~diver@216.85.162.34) Quit (Ping timeout: 480 seconds)
[14:55] * kefu (~kefu@114.86.209.219) has joined #ceph
[14:55] <btaylor> should i be seeing close to native disk write speeds on a non-busy cluster? i???ve created a pool with size 1, and another with size 3, but my tests seem all over the place.
[14:56] * ffilz (~ffilz@66.187.232.65) Quit (Ping timeout: 480 seconds)
[14:56] * ffilz (~ffilz@66.187.232.65) has joined #ceph
[14:58] * T1w (~jens@node3.survey-it.dk) has joined #ceph
[14:58] * yanzheng (~zhyan@125.70.22.217) has joined #ceph
[14:59] * diver_ (~diver@95.85.8.93) Quit ()
[15:01] * rwheeler (~rwheeler@nat-pool-bos-t.redhat.com) has joined #ceph
[15:03] <Be-El> btaylor: with the amount of information given the answer is a definite maybe
[15:04] <btaylor> i just did a couple of quick dd???s and got 1.4GBps writing out 41mb and 410mb.
[15:04] <btaylor> but 4.1gb and 41gb dropped down below 100MBps
[15:04] <btaylor> bs=4k count=10000...
[15:05] * vbellur (~vijay@nat-pool-bos-u.redhat.com) has joined #ceph
[15:05] <Be-El> ceph version, number of osd, pool type, pool size, network bandwidth, use case (cephfs/rbd/rados/whatever) etc?
[15:06] <ledgr> btaylor: try turn off wbthrottle
[15:06] <btaylor> all rbd/block devs. jewel, 207 osd???s, 4x10gbps bonds. pg_num 8192, size 3
[15:06] <btaylor> all ssd
[15:07] <btaylor> 356MBps when i dd direct to disk before importing it as an osd
[15:08] <btaylor> running ???fio --filename=/dev/sdb --direct=1 --sync=1 --rw=write --bs=4k --numjobs=1 --iodepth=1 --runtime=60 --time_based --group_reporting --name=journal-test??? i hit a max of ~180MBps with 3-4 jobs
[15:09] <btaylor> hosts are 24 drive, controller set to jbod
[15:09] <Be-El> the write throughput of the ssd is just 356 mb/s?
[15:09] <btaylor> yeah, micron m500dc
[15:09] * ivve (~zed@cust-gw-11.se.zetup.net) Quit (Ping timeout: 480 seconds)
[15:11] <Be-El> so you can do the math.......4k writes, every write is synchronous to journal, replication size 3 (the replicate are written in parallel afaik), network RTT overhead etc.
[15:11] <Be-El> and as ledgr already said, you might run into wbthrottle
[15:12] * rakeshgm (~rakesh@125.16.34.66) Quit (Ping timeout: 480 seconds)
[15:13] <ledgr> btaylor: let me guess, on that host having 24 drives you have SAS expander connected to HBA?
[15:14] <btaylor> ledgr: i think that???s right. megaraid sas controller
[15:14] <ledgr> even so, you should get better performance. i'm just saying, that sas expander will become bottleneck at some point.
[15:16] <btaylor> looking into wbthrottle???is that a xfs option?
[15:16] <btaylor> so i???d set that when creating the osd and formatting?
[15:16] <Be-El> btaylor: no, it's a bunch of osd options
[15:18] * rmart04_ (~rmart04@support.memset.com) has joined #ceph
[15:18] * ffilzwin (~ffilz@66.187.232.65) has joined #ceph
[15:19] * dneary (~dneary@pool-96-233-46-27.bstnma.fios.verizon.net) has joined #ceph
[15:19] <btaylor> ok found this, http://lists.opennebula.org/pipermail/ceph-users-ceph.com/2014-August/042532.html
[15:19] <ledgr> ceph daemon (mds|osd).<id> config set filestore_wbthrottle_enable false
[15:19] <Be-El> ledgr: afaik you cannot disable it completely without osd restart
[15:20] <btaylor> ok
[15:20] <ledgr> I have noticed that with version 10.2.3 it says (unchangeable) when trying to disable
[15:20] <ledgr> Be-El: what do you mean completely?
[15:21] <Be-El> ledgr: filestore_wbthrottble_enable=false disable wbthrottle completely; i would propose to adjust the settings instead of disabling it
[15:22] * kefu (~kefu@114.86.209.219) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[15:22] * rakeshgm (~rakesh@125.16.34.66) has joined #ceph
[15:22] <btaylor> "success": "filestore_wbthrottle_enable = 'false' (unchangeable) "
[15:22] <ledgr> Be-El: yes, agree. Better insanely high limit that no limit at all
[15:23] <ledgr> btaylor: it says unchangeable, but it does change
[15:23] <btaylor> ok
[15:23] * rmart04 (~rmart04@5.153.255.226) Quit (Ping timeout: 480 seconds)
[15:23] * rmart04_ is now known as rmart04
[15:23] <ledgr> Do it for all mds and osd
[15:23] <btaylor> i hav e0 mds
[15:23] <btaylor> but it seems i have to run that on the specific osd hosts, can???t just run from 1 node to hit all
[15:26] * rdas (~rdas@125.16.200.50) Quit (Ping timeout: 480 seconds)
[15:28] <btaylor> dd if=/dev/zero of=test.tmp bs=4K count=10000000
[15:28] <btaylor> 40960000000 bytes (41 GB) copied, 32.864 s, 1.2 GB/s
[15:28] <btaylor> nice.
[15:28] <Be-El> add conv=fdatasync
[15:34] * rmart04 (~rmart04@support.memset.com) Quit (Ping timeout: 480 seconds)
[15:37] * mhack (~mhack@nat-pool-bos-t.redhat.com) has joined #ceph
[15:37] * salwasser (~Adium@72.246.3.14) has joined #ceph
[15:37] <btaylor> 40960000000 bytes (41 GB) copied, 58.4116 s, 701 MB/s with the fdatasync
[15:41] <btaylor> 2nd pool got 300MBps. would the ???size??? drop that?
[15:41] <btaylor> pg num?
[15:43] * fandi__ (~fandi@202.158.9.166) Quit (Ping timeout: 480 seconds)
[15:45] * rakeshgm (~rakesh@125.16.34.66) Quit (Quit: Peace :))
[15:49] * mhack (~mhack@nat-pool-bos-t.redhat.com) Quit (Ping timeout: 480 seconds)
[15:49] * doppelgrau (~doppelgra@132.252.235.172) Quit (Quit: Leaving.)
[15:49] * mhack (~mhack@nat-pool-bos-t.redhat.com) has joined #ceph
[15:53] * yanzheng (~zhyan@125.70.22.217) Quit (Quit: This computer has gone to sleep)
[15:54] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) Quit (Remote host closed the connection)
[15:54] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) has joined #ceph
[15:57] * squizzi (~squizzi@107.13.237.240) has joined #ceph
[16:00] * Ramakrishnan (~ramakrish@125.16.34.66) Quit (Ping timeout: 480 seconds)
[16:00] * rmart04 (~rmart04@support.memset.com) has joined #ceph
[16:03] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) Quit (Ping timeout: 480 seconds)
[16:04] * rdas (~rdas@125.16.200.50) has joined #ceph
[16:07] * yanzheng (~zhyan@125.70.22.217) has joined #ceph
[16:10] * bagir (~bagir@85.26.168.125) Quit ()
[16:10] * FidoNet (~FidoNet@seattle.morby.org) Quit (Quit: FidoNet)
[16:12] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) has joined #ceph
[16:12] * T1w (~jens@node3.survey-it.dk) Quit (Ping timeout: 480 seconds)
[16:14] * xarses (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[16:15] * yanzheng (~zhyan@125.70.22.217) Quit (Quit: This computer has gone to sleep)
[16:18] * ahadi (~ahadi@static.151.64.243.136.clients.your-server.de) Quit (Quit: leaving)
[16:20] * vbellur (~vijay@nat-pool-bos-u.redhat.com) Quit (Ping timeout: 480 seconds)
[16:21] * valeech (~valeech@50-242-253-97-static.hfc.comcastbusiness.net) Quit (Quit: valeech)
[16:30] <AlbertR> I started creating pg command "ceph pg force_create_pg 2.1ab". For several days he was creating, and nothing happens to him. Is it possible to restore it as the? http://pastebin.com/LaikzgxD
[16:31] * vbellur (~vijay@nat-pool-bos-t.redhat.com) has joined #ceph
[16:31] * sudocat1 (~dibarra@104-188-116-197.lightspeed.hstntx.sbcglobal.net) has joined #ceph
[16:31] * hoonetorg (~hoonetorg@77.119.226.254.static.drei.at) Quit (Ping timeout: 480 seconds)
[16:31] * sudocat (~dibarra@2602:306:8bc7:4c50:613b:127:527:bc8) Quit (Quit: Leaving.)
[16:33] * Roy1 (~Jaska@89.221.209.100) has joined #ceph
[16:34] * kefu (~kefu@114.86.209.219) has joined #ceph
[16:34] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) Quit (Ping timeout: 480 seconds)
[16:36] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) has joined #ceph
[16:37] * nardial (~ls@p5DC0723A.dip0.t-ipconnect.de) Quit (Quit: Leaving)
[16:37] * doppelgrau (~doppelgra@dslb-088-072-094-200.088.072.pools.vodafone-ip.de) has joined #ceph
[16:39] * sudocat1 (~dibarra@104-188-116-197.lightspeed.hstntx.sbcglobal.net) Quit (Ping timeout: 480 seconds)
[16:41] * rdas (~rdas@125.16.200.50) Quit (Quit: Leaving)
[16:43] * shaunm (~shaunm@ms-208-102-105-216.gsm.cbwireless.com) has joined #ceph
[16:46] * vata (~vata@207.96.182.162) has joined #ceph
[16:47] * yanzheng (~zhyan@125.70.22.217) has joined #ceph
[16:49] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) Quit (Remote host closed the connection)
[16:49] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) has joined #ceph
[16:55] * TMM (~hp@185.5.121.201) Quit (Quit: Ex-Chat)
[16:56] * yanzheng (~zhyan@125.70.22.217) Quit (Quit: This computer has gone to sleep)
[16:58] * walcubi (~walcubi@p5099a7c3.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[16:59] <ledgr> btaylor: so turning off wbthrottle helped?
[16:59] * sudocat (~dibarra@192.185.1.20) has joined #ceph
[17:00] <btaylor> i think so???partially. my sysbench tests are still about the same as before
[17:00] <btaylor> mysql/OLTP is getting about 3k-3500 rps
[17:02] <btaylor> do pg num and size play into the stats too? or is it mainly blocksize
[17:02] * sudocat1 (~dibarra@192.185.1.20) has joined #ceph
[17:02] * sudocat (~dibarra@192.185.1.20) Quit ()
[17:03] <ledgr> Be-El: I have 3 OSDs that are used for cache tier. All three OSDs are showing different numbers
[17:03] <ledgr> OSD#1
[17:03] <ledgr> "tier_promote": 8671628,
[17:03] <ledgr> "tier_flush": 0,
[17:03] <ledgr> "tier_flush_fail": 0,
[17:03] <ledgr> "tier_evict": 0,
[17:03] <ledgr> OSD#2
[17:03] <ledgr> "tier_promote": 960606,
[17:03] <ledgr> "tier_flush": 0,
[17:03] * Roy1 (~Jaska@89.221.209.100) Quit ()
[17:03] <ledgr> "tier_flush_fail": 0,
[17:03] <ledgr> OSD#3
[17:03] <ledgr> "tier_promote": 5717004,
[17:03] <ledgr> "tier_flush": 0,
[17:03] <ledgr> "tier_flush_fail": 0,
[17:04] <ledgr> "tier_evict": 0,
[17:04] * yanzheng (~zhyan@125.70.22.217) has joined #ceph
[17:04] <ledgr> If I want to know promotes/flushed/evicts rate. Do I need to sum values?
[17:05] <ledgr> And why do I get such different values?
[17:05] <ledgr> Is this counter updated only on primary OSD?
[17:06] <ledgr> It seems values are updated on all OSDs, but they are very very different
[17:07] <ledgr> btaylor: for IOPs it's mostly size of the pool and latency of all the components in the system.
[17:08] <ledgr> cpu, network, controller, ceph configuration, kernel configuration etc etc etc
[17:09] <btaylor> hmmok
[17:10] <ledgr> anyway, your sas expander will become bottleneck sooner or later
[17:10] * yanzheng (~zhyan@125.70.22.217) Quit (Quit: This computer has gone to sleep)
[17:10] * rdas (~rdas@125.16.200.50) has joined #ceph
[17:11] * johnavp1989 (~jpetrini@yakko.coredial.com) has joined #ceph
[17:11] <- *johnavp1989* To prove that you are human, please enter the result of 8+3
[17:12] * wushudoin (~wushudoin@38.140.108.2) has joined #ceph
[17:15] * analbeard (~shw@support.memset.com) Quit (Ping timeout: 480 seconds)
[17:22] <AlbertR> Please, help me. How can i restart creating stuck pg ?
[17:25] * dgurtner (~dgurtner@sessfw99-sesbfw99-88.ericsson.net) Quit (Ping timeout: 480 seconds)
[17:28] * niknakpaddywak (~xander.ni@outbound.lax.demandmedia.com) Quit (Remote host closed the connection)
[17:36] * jowilkin (~jowilkin@184-23-213-254.fiber.dynamic.sonic.net) Quit (Remote host closed the connection)
[17:37] * JarekO (~jowsie@hC35A6AF2.cli.nitronet.pl) has joined #ceph
[17:38] * Nicho1as (~nicho1as@00022427.user.oftc.net) Quit (Quit: A man from the Far East; using WeeChat 1.5)
[17:39] * Unai (~Adium@2604:5500:1b:5e2:f47a:a05a:72d9:69db) has joined #ceph
[17:39] * neurodrone (~neurodron@158.106.193.162) has joined #ceph
[17:40] * jowilkin (~jowilkin@184-23-213-254.fiber.dynamic.sonic.net) has joined #ceph
[17:40] <neurodrone> Is the slack channel lagged again?
[17:42] * JarekO_ (~jowsie@hC35A6AF2.cli.nitronet.pl) Quit (Ping timeout: 480 seconds)
[17:45] * dneary (~dneary@pool-96-233-46-27.bstnma.fios.verizon.net) Quit (Ping timeout: 480 seconds)
[17:48] * shorton (~oftc-webi@50.58.7.244) has joined #ceph
[17:48] * Be-El (~blinke@nat-router.computational.bio.uni-giessen.de) Quit (Quit: Leaving.)
[17:48] * andrew_m (~Thononain@108.61.122.214) has joined #ceph
[17:50] * xarses (~xarses@64.124.158.3) has joined #ceph
[17:51] * TMM (~hp@dhcp-077-248-009-229.chello.nl) has joined #ceph
[17:51] * TMM_ (~hp@dhcp-077-248-009-229.chello.nl) has joined #ceph
[17:53] * vbellur (~vijay@nat-pool-bos-t.redhat.com) Quit (Ping timeout: 480 seconds)
[17:54] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) Quit (Remote host closed the connection)
[17:54] * jowilkin (~jowilkin@184-23-213-254.fiber.dynamic.sonic.net) Quit (Remote host closed the connection)
[17:54] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) has joined #ceph
[17:54] * blizzow (~jburns@2601:280:4a00:4c00:fae4:f4b0:66e2:e966) has joined #ceph
[17:55] <shorton> It seems I have crashed my 3 node ceph jewel cluster, cannot get OSDs to come up. Would anyone here be able to guide me on how to recover...I've tried everything I know.
[17:56] * vimal (~vikumar@125.16.200.50) Quit (Quit: Leaving)
[17:56] * Unai (~Adium@2604:5500:1b:5e2:f47a:a05a:72d9:69db) Quit (Ping timeout: 480 seconds)
[17:56] * TMM (~hp@dhcp-077-248-009-229.chello.nl) Quit (Quit: Ex-Chat)
[17:59] * valeech (~valeech@50-202-0-38-static.hfc.comcastbusiness.net) has joined #ceph
[18:00] <shorton> I tried re-running ceph-deploy mon create-initial, but am now getting Permission denied many places
[18:02] * vbellur (~vijay@nat-pool-bos-t.redhat.com) has joined #ceph
[18:02] * derjohn_mob (~aj@46.189.28.57) Quit (Ping timeout: 480 seconds)
[18:02] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) Quit (Ping timeout: 480 seconds)
[18:03] * Skaag (~lunix@65.200.54.234) has joined #ceph
[18:03] * rmart04 (~rmart04@support.memset.com) has left #ceph
[18:06] * newbie (~kvirc@host217-114-156-249.pppoe.mark-itt.net) has joined #ceph
[18:08] * rraja (~rraja@125.16.34.66) Quit (Quit: Leaving)
[18:08] * rdas (~rdas@125.16.200.50) Quit (Quit: Leaving)
[18:09] <blizzow> shorton, What platform?
[18:10] * fandi (~fandi@112.78.178.19) has joined #ceph
[18:11] * kefu (~kefu@114.86.209.219) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[18:13] * kefu_ (~kefu@114.86.209.219) has joined #ceph
[18:14] * Hemanth (~hkumar_@125.16.34.66) Quit (Ping timeout: 480 seconds)
[18:15] * ledgr (~ledgr@88-222-11-185.meganet.lt) has joined #ceph
[18:18] * andrew_m (~Thononain@108.61.122.214) Quit ()
[18:19] * trololo (~cypher@fra06-3-78-243-232-119.fbx.proxad.net) Quit (Ping timeout: 480 seconds)
[18:21] * ledgr (~ledgr@88-222-11-185.meganet.lt) Quit (Remote host closed the connection)
[18:23] * ledgr (~ledgr@88-222-11-185.meganet.lt) has joined #ceph
[18:28] * sugoruyo (~georgev@paarthurnax.esc.rl.ac.uk) has joined #ceph
[18:31] * derjohn_mob (~aj@46.183.103.8) has joined #ceph
[18:32] * irq0 (~seri@amy.irq0.org) Quit (Quit: NubiaReuter)
[18:37] <sugoruyo> hi folks, I'm wondering if someone can help me figure out why my cluster has a PG (on an EC8+3 pool) stuck in activating+degraded
[18:38] * ledgr (~ledgr@88-222-11-185.meganet.lt) Quit (Remote host closed the connection)
[18:39] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) has joined #ceph
[18:39] * hbogert (~Adium@95.170.93.16) Quit (Quit: Leaving.)
[18:43] * vasu (~vasu@c-73-231-60-138.hsd1.ca.comcast.net) has joined #ceph
[18:44] * ade (~abradshaw@188.29.165.216.threembb.co.uk) Quit (Ping timeout: 480 seconds)
[18:48] * kristen (~kristen@134.134.139.76) has joined #ceph
[18:52] * ircolle (~Adium@2601:285:201:633a:3867:4b51:dbd8:8a43) has joined #ceph
[18:52] * walcubi (~walcubi@p5797AE18.dip0.t-ipconnect.de) has joined #ceph
[19:00] * ade (~abradshaw@188.29.165.216.threembb.co.uk) has joined #ceph
[19:01] * ade (~abradshaw@188.29.165.216.threembb.co.uk) Quit ()
[19:08] * post-factum (~post-fact@vulcan.natalenko.name) Quit (Killed (NickServ (Too many failed password attempts.)))
[19:08] * post-factum (~post-fact@vulcan.natalenko.name) has joined #ceph
[19:11] * krypto (~krypto@G68-90-105-121.sbcis.sbc.com) has joined #ceph
[19:12] * wjw-freebsd (~wjw@smtp.digiware.nl) has joined #ceph
[19:13] * kefu_ (~kefu@114.86.209.219) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[19:13] * Vacuum__ (~Vacuum@i59F791F8.versanet.de) has joined #ceph
[19:14] * shorton (~oftc-webi@50.58.7.244) Quit (Quit: Page closed)
[19:20] * Rickus (~Rickus@office.protected.ca) Quit (Quit: Leaving)
[19:20] * Vacuum_ (~Vacuum@88.130.205.74) Quit (Ping timeout: 480 seconds)
[19:26] * Rickus (~Rickus@office.protected.ca) has joined #ceph
[19:33] * madkiss (~madkiss@2a02:8109:8680:2000:38db:b4d9:f3f7:da42) has joined #ceph
[19:34] * ircolle (~Adium@2601:285:201:633a:3867:4b51:dbd8:8a43) Quit (Quit: Leaving.)
[19:35] * atheism (~atheism@182.48.117.114) Quit (Remote host closed the connection)
[19:36] * valeech (~valeech@50-202-0-38-static.hfc.comcastbusiness.net) Quit (Quit: valeech)
[19:40] * atheism (~atheism@182.48.117.114) has joined #ceph
[19:44] * derjohn_mob (~aj@46.183.103.8) Quit (Ping timeout: 480 seconds)
[19:47] * post-factum (~post-fact@vulcan.natalenko.name) Quit (Killed (NickServ (Too many failed password attempts.)))
[19:47] * post-factum (~post-fact@vulcan.natalenko.name) has joined #ceph
[19:55] * mhack (~mhack@nat-pool-bos-t.redhat.com) Quit (Ping timeout: 480 seconds)
[19:56] * mhack (~mhack@nat-pool-bos-t.redhat.com) has joined #ceph
[19:56] * georgem1 (~Adium@206.108.127.16) has joined #ceph
[19:57] * wjw-freebsd (~wjw@smtp.digiware.nl) Quit (Ping timeout: 480 seconds)
[20:01] * georgem (~Adium@206.108.127.16) Quit (Ping timeout: 480 seconds)
[20:04] * Hemanth (~hkumar_@103.228.221.180) has joined #ceph
[20:09] * bc2946088 (uid192258@id-192258.brockwell.irccloud.com) has joined #ceph
[20:11] <bc2946088> Hey everyone! I setup a ceph cluster using 3 monitors and 1 pool group (rbd). I'm trying to add a block device, which I did, however, even after mounting the directory on each monitor, my changes aren't replicated, at least visually on each systems mount /mnt/cluster01-data. Am I misunderstanding the functionality?
[20:15] * lcurtis (~lcurtis@47.19.105.250) has joined #ceph
[20:16] <ledgr> did you mount rbd device on each monitor?
[20:16] <bc2946088> I believe I just figured it out. The filesystem is chose is not cluster-aware.
[20:17] <bc2946088> I did ledgr. /dev/rbd0 1008G 15M 1008G 1% /mnt/cluster01-data shows on each system but no changes occur from one node to the next when I write to the mount
[20:19] <ledgr> rbd image is just an image. it is not cluster filesystem. you will not see changes on all the nodes. if you need to see changes on all the nodes you must use some kind of cluster-fs on top of rbd image
[20:19] <ledgr> in other words, it's not how rbd works
[20:19] * johnavp1989 (~jpetrini@yakko.coredial.com) Quit (Quit: Leaving.)
[20:20] * johnavp1989 (~jpetrini@yakko.coredial.com) has joined #ceph
[20:20] <- *johnavp1989* To prove that you are human, please enter the result of 8+3
[20:22] <bc2946088> ledgr: That would explain it. Seeing the changes isn't really all that necessary, just a nicety, however, I suppose I would like to avoid any complexity.
[20:27] * jowilkin (~jowilkin@184-23-213-254.fiber.dynamic.sonic.net) has joined #ceph
[20:28] * johnavp1989 (~jpetrini@yakko.coredial.com) Quit (Ping timeout: 480 seconds)
[20:34] * stiopa (~stiopa@cpc73832-dals21-2-0-cust453.20-2.cable.virginm.net) has joined #ceph
[20:35] * niknakpaddywak (~xander.ni@outbound.lax.demandmedia.com) has joined #ceph
[20:39] * wushudoin_ (~wushudoin@38.140.108.2) has joined #ceph
[20:40] * mhack (~mhack@nat-pool-bos-t.redhat.com) Quit (Ping timeout: 480 seconds)
[20:43] * dneary (~dneary@nat-pool-bos-u.redhat.com) has joined #ceph
[20:44] * wushudoin (~wushudoin@38.140.108.2) Quit (Ping timeout: 480 seconds)
[20:46] * valeech (~valeech@50-242-253-97-static.hfc.comcastbusiness.net) has joined #ceph
[20:49] * haplo37 (~haplo37@199.91.185.156) has joined #ceph
[20:51] * mhack (~mhack@nat-pool-bos-u.redhat.com) has joined #ceph
[21:02] * Dominik_H (~Dominik_H@176.52.197.160.suec-dacor.de) has joined #ceph
[21:05] * jarrpa (~jarrpa@63.225.131.166) Quit (Quit: Back to reality...)
[21:07] * evelu (~erwan@2a01:e34:eecb:7400:4eeb:42ff:fedc:8ac) Quit (Quit: Leaving)
[21:07] * evelu (~erwan@2a01:e34:eecb:7400:4eeb:42ff:fedc:8ac) has joined #ceph
[21:12] * hbogert (~Adium@ip54541f88.adsl-surfen.hetnet.nl) has joined #ceph
[21:16] * winmutt (~rolfmarti@199.33.145.32) Quit (Read error: Connection reset by peer)
[21:16] * mhack (~mhack@nat-pool-bos-u.redhat.com) Quit (Ping timeout: 480 seconds)
[21:17] * krypto (~krypto@G68-90-105-121.sbcis.sbc.com) Quit (Read error: Connection reset by peer)
[21:17] * winmutt (~rolfmarti@199.33.145.32) has joined #ceph
[21:19] * johnavp1989 (~jpetrini@pool-100-14-10-2.phlapa.fios.verizon.net) has joined #ceph
[21:19] <- *johnavp1989* To prove that you are human, please enter the result of 8+3
[21:25] * mhack (~mhack@nat-pool-bos-t.redhat.com) has joined #ceph
[21:27] * johnavp1989 (~jpetrini@pool-100-14-10-2.phlapa.fios.verizon.net) Quit (Ping timeout: 480 seconds)
[21:34] * haplo37 (~haplo37@199.91.185.156) Quit (Ping timeout: 480 seconds)
[21:34] * davidzlap (~Adium@2605:e000:1313:8003:f004:2e36:2116:4f36) has joined #ceph
[21:39] * johnavp1989 (~jpetrini@8.39.115.8) has joined #ceph
[21:39] <- *johnavp1989* To prove that you are human, please enter the result of 8+3
[21:43] * rotbeard (~redbeard@185.32.80.238) Quit (Quit: Leaving)
[21:45] * jowilkin (~jowilkin@184-23-213-254.fiber.dynamic.sonic.net) Quit (Remote host closed the connection)
[21:47] * georgem (~Adium@206.108.127.16) has joined #ceph
[21:47] * georgem1 (~Adium@206.108.127.16) Quit (Read error: Connection reset by peer)
[22:01] * salwasser (~Adium@72.246.3.14) Quit (Quit: Leaving.)
[22:07] * winmutt (~rolfmarti@199.33.145.32) Quit (Ping timeout: 480 seconds)
[22:07] * nilez (~nilez@ec2-52-37-170-77.us-west-2.compute.amazonaws.com) Quit (Read error: Connection reset by peer)
[22:13] * winmutt (~rolfmarti@199.33.145.32) has joined #ceph
[22:15] * rwheeler (~rwheeler@nat-pool-bos-t.redhat.com) Quit (Quit: Leaving)
[22:18] * georgem (~Adium@206.108.127.16) Quit (Quit: Leaving.)
[22:22] * mnc (~mnc@c-50-137-214-131.hsd1.mn.comcast.net) has joined #ceph
[22:23] * f2 (~lucifred@nat-pool-bos-t.redhat.com) has joined #ceph
[22:24] <f2> mnc: https://mojo.redhat.com/docs/DOC-1076205
[22:25] * bniver (~bniver@71-9-144-29.static.oxfr.ma.charter.com) Quit (Quit: Leaving)
[22:43] * vbellur (~vijay@nat-pool-bos-t.redhat.com) Quit (Quit: Leaving.)
[22:43] * wido (~wido@2a00:f10:121:100:4a5:76ff:fe00:199) Quit (Quit: No Ping reply in 180 seconds.)
[22:44] * wido (~wido@2a00:f10:121:100:4a5:76ff:fe00:199) has joined #ceph
[22:45] * derjohn_mob (~aj@x590cb2af.dyn.telefonica.de) has joined #ceph
[22:48] * jarrpa (~jarrpa@63.225.131.166) has joined #ceph
[22:51] * bene2 (~bene@2601:193:4101:f410:ea2a:eaff:fe08:3c7a) Quit (Quit: Konversation terminated!)
[22:52] * ircolle (~Adium@2601:285:201:633a:3867:4b51:dbd8:8a43) has joined #ceph
[22:53] * wjw-freebsd (~wjw@smtp.digiware.nl) has joined #ceph
[22:55] * f2 (~lucifred@nat-pool-bos-t.redhat.com) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[23:01] * jowilkin (~jowilkin@184-23-213-254.fiber.dynamic.sonic.net) has joined #ceph
[23:04] <jowilkin> edonnell: The first one is in the S3 API. They are the same across RHEL and Ubuntu as far as topics. He's just saying we don't have those calls documented. It would have been nice if he'd added them to the BZ.
[23:06] <jowilkin> edonnell: So this would start around here: https://access.redhat.com/documentation/en/red-hat-ceph-storage/2/paged/object-gateway-guide-for-red-hat-enterprise-linux/chapter-6-object-gateway-s3-api
[23:08] <mnaser> Would anyone know how to get stats per specific pool?
[23:08] <mnaser> rados df gives me usage and object# of a pool (we use rbd)
[23:09] <mnaser> but we have two roots (one with ssds, one with hdds)
[23:09] <mnaser> so the total space/avail in rados df doesnt give an accurate reflection
[23:10] * f2 (~lucifred@nat-pool-bos-t.redhat.com) has joined #ceph
[23:12] * dneary (~dneary@nat-pool-bos-u.redhat.com) Quit (Ping timeout: 480 seconds)
[23:20] * kristen (~kristen@134.134.139.76) Quit (Quit: Leaving)
[23:22] * ffilzwin (~ffilz@66.187.232.65) Quit (Quit: Leaving)
[23:23] * ffilz (~ffilz@66.187.232.65) Quit (Quit: Leaving)
[23:30] * Hemanth (~hkumar_@103.228.221.180) Quit (Ping timeout: 480 seconds)
[23:31] * valeech (~valeech@50-242-253-97-static.hfc.comcastbusiness.net) Quit (Quit: valeech)
[23:33] * hbogert (~Adium@ip54541f88.adsl-surfen.hetnet.nl) Quit (Quit: Leaving.)
[23:35] * Jeffrey4l (~Jeffrey@110.244.236.231) Quit (Read error: Connection reset by peer)
[23:38] * winmutt (~rolfmarti@199.33.145.32) Quit (Ping timeout: 480 seconds)
[23:39] * newbie (~kvirc@host217-114-156-249.pppoe.mark-itt.net) Quit (Ping timeout: 480 seconds)
[23:40] * hoonetorg (~hoonetorg@77.119.226.254.static.drei.at) has joined #ceph
[23:42] * Racpatel (~Racpatel@2601:87:3:31e3::3840) Quit (Ping timeout: 480 seconds)
[23:46] * doppelgrau (~doppelgra@dslb-088-072-094-200.088.072.pools.vodafone-ip.de) Quit (Quit: doppelgrau)
[23:47] * davidzlap (~Adium@2605:e000:1313:8003:f004:2e36:2116:4f36) Quit (Quit: Leaving.)
[23:49] * davidzlap (~Adium@cpe-172-91-154-245.socal.res.rr.com) has joined #ceph
[23:53] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) Quit (Remote host closed the connection)
[23:53] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) has joined #ceph
[23:53] <s3an2> maybe ceph osd df tree parsed a little will help
[23:54] * om (~om@66.215.128.117) Quit (Quit: Leaving)
[23:54] * davidzlap (~Adium@cpe-172-91-154-245.socal.res.rr.com) Quit (Quit: Leaving.)
[23:55] * davidzlap (~Adium@cpe-172-91-154-245.socal.res.rr.com) has joined #ceph
[23:56] * om (~om@66.215.128.117) has joined #ceph
[23:58] * fsimonce (~simon@95.239.69.67) Quit (Quit: Coyote finally caught me)
[23:58] * dgurtner (~dgurtner@c-217-115-42-158.cust.bredband2.com) has joined #ceph

These logs were automatically created by CephLogBot on irc.oftc.net using the Java IRC LogBot.