#ceph IRC Log

Index

IRC Log for 2015-06-27

Timestamps are in GMT/BST.

[0:02] * dopesong (~dopesong@78-60-74-130.static.zebra.lt) Quit (Remote host closed the connection)
[0:05] * MentalRay (~MRay@MTRLPQ42-1176054809.sdsl.bell.ca) Quit (Ping timeout: 480 seconds)
[0:14] * dgurtner (~dgurtner@217-162-119-191.dynamic.hispeed.ch) has joined #ceph
[0:15] * alram (~alram@cpe-172-250-2-46.socal.res.rr.com) Quit (Quit: Lost terminal)
[0:20] * DV (~veillard@2001:41d0:1:d478::1) has joined #ceph
[0:25] * Concubidated (~Adium@192.170.161.35) Quit (Quit: Leaving.)
[0:28] * jwilkins (~jwilkins@2601:644:4100:bfef:ea2a:eaff:fe08:3f1d) Quit (Quit: Leaving)
[0:28] * DV_ (~veillard@2001:41d0:1:d478::1) has joined #ceph
[0:29] * tuhnis (~rushworld@46.166.138.165) has joined #ceph
[0:30] * TheSov3 (~TheSov@cip-248.trustwave.com) Quit (Read error: Connection reset by peer)
[0:32] * alram (~alram@cpe-172-250-2-46.socal.res.rr.com) has joined #ceph
[0:34] * debian112 (~bcolbert@24.126.201.64) Quit (Quit: Leaving.)
[0:38] * qhartman (~qhartman@den.direwolfdigital.com) has joined #ceph
[0:47] * yguang11 (~yguang11@nat-dip30-wl-d.cfw-a-gci.corp.yahoo.com) Quit (Read error: Connection reset by peer)
[0:47] * yguang11 (~yguang11@2001:4998:effd:600:92b:7ecd:782c:8bd2) has joined #ceph
[0:47] * vata (~vata@208.88.110.46) Quit (Quit: Leaving.)
[0:52] * sleinen1 (~Adium@2001:620:0:82::102) Quit (Ping timeout: 480 seconds)
[0:53] * dgurtner (~dgurtner@217-162-119-191.dynamic.hispeed.ch) Quit (Ping timeout: 480 seconds)
[0:59] * tuhnis (~rushworld@46.166.138.165) Quit ()
[1:05] * mookins (~mookins@induct3.lnk.telstra.net) has joined #ceph
[1:12] * lcurtis (~lcurtis@47.19.105.250) Quit (Remote host closed the connection)
[1:16] * romel (~romel@romel.org.ua) has joined #ceph
[1:17] * gregmark (~Adium@68.87.42.115) Quit (Quit: Leaving.)
[1:34] * moore_ (~moore@63-232-3-122.dia.static.qwest.net) has joined #ceph
[1:35] * bgleb (~bgleb@130.193.35.243-vpna.dhcp.yndx.net) has joined #ceph
[1:35] * Corti^carte (~blank@89.248.172.147) has joined #ceph
[1:37] <bgleb> hi there! we just updated to 0.94.2 and search for solution on garbage (we made a lot of object deletion and rewrite since upgrade 0.87 => 0.94 with civetweb as frontend). How we can remove all such objects from pool?
[1:37] * moore__ (~moore@64.202.160.88) has joined #ceph
[1:38] <bgleb> we have about 70TiB of such data (calculated as total used minus sum of all buckets usage)
[1:38] * moore (~moore@64.202.160.88) Quit (Read error: Connection reset by peer)
[1:38] * wschulze (~wschulze@cpe-69-206-240-164.nyc.res.rr.com) has joined #ceph
[1:38] <bgleb> I've run radosgw-admin check bucket but it seems that it output only objects prefixed with underscore (eg.: _multipart_*)
[1:39] * moore__ (~moore@64.202.160.88) Quit (Remote host closed the connection)
[1:41] * stiopa (~stiopa@cpc73828-dals21-2-0-cust630.20-2.cable.virginm.net) Quit (Ping timeout: 480 seconds)
[1:42] * debian112 (~bcolbert@24.126.201.64) has joined #ceph
[1:44] * moore_ (~moore@63-232-3-122.dia.static.qwest.net) Quit (Ping timeout: 480 seconds)
[1:44] <bgleb> I have an idea about cross bucket copying (CopyObjectRequest using S3 API) and placing buckets on different rados pools, but it seems difficult. Do we have any built-in tools to remove all objects from pool that doesn't belongs to any object in known buckets?
[1:45] * oms101 (~oms101@p20030057EA05C500C6D987FFFE4339A1.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[1:50] * vbellur (~vijay@50-206-204-8-static.hfc.comcastbusiness.net) has joined #ceph
[1:53] * oms101 (~oms101@p20030057EA05AD00C6D987FFFE4339A1.dip0.t-ipconnect.de) has joined #ceph
[1:58] * andreww (~xarses@12.164.168.117) Quit (Ping timeout: 480 seconds)
[1:58] * fdmanana__ (~fdmanana@bl13-155-180.dsl.telepac.pt) Quit (Ping timeout: 480 seconds)
[2:06] * circ-user-nNWGw (~circuser-@50.46.225.207) has joined #ceph
[2:08] * Corti^carte (~blank@89.248.172.147) Quit (Ping timeout: 480 seconds)
[2:16] * bgleb (~bgleb@130.193.35.243-vpna.dhcp.yndx.net) Quit (Remote host closed the connection)
[2:17] * andreww (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) has joined #ceph
[2:24] * badone (~brad@CPE-121-215-241-179.static.qld.bigpond.net.au) has joined #ceph
[2:25] * alram (~alram@cpe-172-250-2-46.socal.res.rr.com) Quit (Quit: leaving)
[2:35] * debian112 (~bcolbert@24.126.201.64) Quit (Quit: Leaving.)
[2:47] * lpabon (~quassel@24-151-54-34.dhcp.nwtn.ct.charter.com) Quit (Remote host closed the connection)
[2:51] * Debesis (0x@213.119.116.89.mobile.mezon.lt) Quit (Ping timeout: 480 seconds)
[2:52] * MentalRay (~MRay@107.171.161.165) has joined #ceph
[2:59] * yguang11 (~yguang11@2001:4998:effd:600:92b:7ecd:782c:8bd2) Quit ()
[3:04] * vbellur (~vijay@50-206-204-8-static.hfc.comcastbusiness.net) Quit (Ping timeout: 480 seconds)
[3:08] * Keiya (~SurfMaths@79.142.70.6) has joined #ceph
[3:08] * tmrz (~quassel@198-84-192-38.cpe.teksavvy.com) has joined #ceph
[3:24] * MACscr|lappy (~MACscrlap@2601:247:4102:c3ac:701e:c37e:7b42:7762) has joined #ceph
[3:25] * yanzheng (~zhyan@182.139.20.134) has joined #ceph
[3:27] <MACscr|lappy> i have a small ceph environment setup with 3 ceph storage nodes with 2 ssd's in each one. I had 3 in each, but had to remove 1 from each. I had a complicated overcomplicated ceph map. I wasnt using the storage at all yet. How can i simply reset the crush map to default?
[3:27] <MACscr|lappy> will the ceph osds be renumbered?
[3:28] <MACscr|lappy> right now everything is stopped
[3:28] <MACscr|lappy> on purpose that is
[3:38] * Keiya (~SurfMaths@9S0AABLLR.tor-irc.dnsbl.oftc.net) Quit ()
[3:40] <ska> I'm not able to install Calamari on debian7 due to dependency issues: http://paste.debian.net/261771/
[3:42] <ska> Has anyone else seen or overcome this problem?
[3:45] * snakamoto (~Adium@192.16.26.2) Quit (Quit: Leaving.)
[3:50] * vbellur (~vijay@50-206-204-8-static.hfc.comcastbusiness.net) has joined #ceph
[3:55] * kefu (~kefu@114.92.102.166) has joined #ceph
[3:59] * elder (~elder@c-24-245-18-91.hsd1.mn.comcast.net) has joined #ceph
[3:59] * ChanServ sets mode +o elder
[3:59] * kefu (~kefu@114.92.102.166) Quit ()
[4:04] * overclk (~overclk@59.93.64.133) has joined #ceph
[4:05] * georgem (~Adium@69-165-162-64.dsl.teksavvy.com) has joined #ceph
[4:05] * kefu (~kefu@114.92.102.166) has joined #ceph
[4:11] * yanzheng (~zhyan@182.139.20.134) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * circ-user-nNWGw (~circuser-@50.46.225.207) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * yghannam (~yghannam@0001f8aa.user.oftc.net) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * evilrob00 (~evilrob00@cpe-72-179-3-209.austin.res.rr.com) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * marrusl (~mark@cpe-67-247-9-253.nyc.res.rr.com) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * zaitcev (~zaitcev@2001:558:6001:10:61d7:f51f:def8:4b0f) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * JoeJulian (~JoeJulian@shared.gaealink.net) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * xdeller (~xdeller@h195-91-128-218.ln.rinet.ru) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * ska (~skatinolo@cpe-173-174-111-177.austin.res.rr.com) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * MrHeavy (~MrHeavy@pool-108-54-190-117.nycmny.fios.verizon.net) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * zenpac (~zenpac3@66.55.33.66) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * dustinm` (~dustinm`@2607:5300:100:200::160d) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * Bosse (~bosse@rifter2.klykken.com) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * andrewschoen (~andrewsch@50.56.86.195) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * _are_ (~quassel@2a01:238:4325:ca00:f065:c93c:f967:9285) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * essjayhch (sid79416@id-79416.ealing.irccloud.com) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * dalegaard-39554 (~dalegaard@vps.devrandom.dk) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * mdxi_ (~mdxi@50-199-109-154-static.hfc.comcastbusiness.net) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * gsilvis (~andovan@c-73-159-49-122.hsd1.ma.comcast.net) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * philips (~philips@ec2-54-196-103-51.compute-1.amazonaws.com) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * rektide (~rektide@eldergods.com) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * pdrakeweb (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * Georgyo (~georgyo@2600:3c03:e000:71::1) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * ivotron (uid25461@id-25461.brockwell.irccloud.com) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * destrudo (~destrudo@64.142.74.180) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * _nick (~nick@zarquon.dischord.org) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * lbarfiel1 (~logan@ralvm.saturne.in) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * Tene (~tene@173.13.139.236) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * martineg (~martin@shell01.copyleft.no) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * kamalmarhubi (sid26581@id-26581.highgate.irccloud.com) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * JohnPreston78 (sid31393@id-31393.charlton.irccloud.com) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * bjornar (~bjornar@109.247.131.38) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * zz_hitsumabushi (~hitsumabu@175.184.30.148) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * Jahkeup (Jahkeup@gemini.ca.us.panicbnc.net) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * MK_FG (~MK_FG@00018720.user.oftc.net) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * ktdreyer (~kdreyer@polyp.adiemus.org) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * _robbat21irssi (nobody@www2.orbis-terrarum.net) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * sbadia (~sbadia@marcellin.sebian.fr) Quit (resistance.oftc.net weber.oftc.net)
[4:11] * real (~lalelu@invincible.the-real.org) Quit (resistance.oftc.net weber.oftc.net)
[4:13] * yanzheng (~zhyan@182.139.20.134) has joined #ceph
[4:13] * circ-user-nNWGw (~circuser-@50.46.225.207) has joined #ceph
[4:13] * yghannam (~yghannam@0001f8aa.user.oftc.net) has joined #ceph
[4:13] * evilrob00 (~evilrob00@cpe-72-179-3-209.austin.res.rr.com) has joined #ceph
[4:13] * marrusl (~mark@cpe-67-247-9-253.nyc.res.rr.com) has joined #ceph
[4:13] * zaitcev (~zaitcev@2001:558:6001:10:61d7:f51f:def8:4b0f) has joined #ceph
[4:13] * JoeJulian (~JoeJulian@shared.gaealink.net) has joined #ceph
[4:13] * xdeller (~xdeller@h195-91-128-218.ln.rinet.ru) has joined #ceph
[4:13] * ska (~skatinolo@cpe-173-174-111-177.austin.res.rr.com) has joined #ceph
[4:13] * MrHeavy (~MrHeavy@pool-108-54-190-117.nycmny.fios.verizon.net) has joined #ceph
[4:13] * zenpac (~zenpac3@66.55.33.66) has joined #ceph
[4:13] * dustinm` (~dustinm`@2607:5300:100:200::160d) has joined #ceph
[4:13] * andrewschoen (~andrewsch@50.56.86.195) has joined #ceph
[4:13] * Bosse (~bosse@rifter2.klykken.com) has joined #ceph
[4:13] * _are_ (~quassel@2a01:238:4325:ca00:f065:c93c:f967:9285) has joined #ceph
[4:13] * essjayhch (sid79416@id-79416.ealing.irccloud.com) has joined #ceph
[4:13] * dalegaard-39554 (~dalegaard@vps.devrandom.dk) has joined #ceph
[4:13] * mdxi_ (~mdxi@50-199-109-154-static.hfc.comcastbusiness.net) has joined #ceph
[4:13] * gsilvis (~andovan@c-73-159-49-122.hsd1.ma.comcast.net) has joined #ceph
[4:13] * philips (~philips@ec2-54-196-103-51.compute-1.amazonaws.com) has joined #ceph
[4:13] * rektide (~rektide@eldergods.com) has joined #ceph
[4:13] * pdrakeweb (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) has joined #ceph
[4:13] * Georgyo (~georgyo@2600:3c03:e000:71::1) has joined #ceph
[4:13] * ivotron (uid25461@id-25461.brockwell.irccloud.com) has joined #ceph
[4:13] * destrudo (~destrudo@64.142.74.180) has joined #ceph
[4:13] * MK_FG (~MK_FG@00018720.user.oftc.net) has joined #ceph
[4:13] * JohnPreston78 (sid31393@id-31393.charlton.irccloud.com) has joined #ceph
[4:13] * kamalmarhubi (sid26581@id-26581.highgate.irccloud.com) has joined #ceph
[4:13] * martineg (~martin@shell01.copyleft.no) has joined #ceph
[4:13] * real (~lalelu@invincible.the-real.org) has joined #ceph
[4:13] * bjornar (~bjornar@109.247.131.38) has joined #ceph
[4:13] * Jahkeup (Jahkeup@gemini.ca.us.panicbnc.net) has joined #ceph
[4:13] * Tene (~tene@173.13.139.236) has joined #ceph
[4:13] * lbarfiel1 (~logan@ralvm.saturne.in) has joined #ceph
[4:13] * ktdreyer (~kdreyer@polyp.adiemus.org) has joined #ceph
[4:13] * _robbat21irssi (nobody@www2.orbis-terrarum.net) has joined #ceph
[4:13] * _nick (~nick@zarquon.dischord.org) has joined #ceph
[4:13] * zz_hitsumabushi (~hitsumabu@175.184.30.148) has joined #ceph
[4:13] * sbadia (~sbadia@marcellin.sebian.fr) has joined #ceph
[4:17] * _nick (~nick@zarquon.dischord.org) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * lbarfiel1 (~logan@ralvm.saturne.in) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * Tene (~tene@173.13.139.236) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * martineg (~martin@shell01.copyleft.no) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * kamalmarhubi (sid26581@id-26581.highgate.irccloud.com) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * JohnPreston78 (sid31393@id-31393.charlton.irccloud.com) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * Georgyo (~georgyo@2600:3c03:e000:71::1) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * pdrakeweb (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * gsilvis (~andovan@c-73-159-49-122.hsd1.ma.comcast.net) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * mdxi_ (~mdxi@50-199-109-154-static.hfc.comcastbusiness.net) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * dalegaard-39554 (~dalegaard@vps.devrandom.dk) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * essjayhch (sid79416@id-79416.ealing.irccloud.com) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * _are_ (~quassel@2a01:238:4325:ca00:f065:c93c:f967:9285) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * Bosse (~bosse@rifter2.klykken.com) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * MrHeavy (~MrHeavy@pool-108-54-190-117.nycmny.fios.verizon.net) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * ska (~skatinolo@cpe-173-174-111-177.austin.res.rr.com) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * xdeller (~xdeller@h195-91-128-218.ln.rinet.ru) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * JoeJulian (~JoeJulian@shared.gaealink.net) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * zaitcev (~zaitcev@2001:558:6001:10:61d7:f51f:def8:4b0f) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * marrusl (~mark@cpe-67-247-9-253.nyc.res.rr.com) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * evilrob00 (~evilrob00@cpe-72-179-3-209.austin.res.rr.com) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * destrudo (~destrudo@64.142.74.180) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * bjornar (~bjornar@109.247.131.38) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * zenpac (~zenpac3@66.55.33.66) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * zz_hitsumabushi (~hitsumabu@175.184.30.148) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * Jahkeup (Jahkeup@gemini.ca.us.panicbnc.net) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * MK_FG (~MK_FG@00018720.user.oftc.net) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * ktdreyer (~kdreyer@polyp.adiemus.org) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * andrewschoen (~andrewsch@50.56.86.195) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * ivotron (uid25461@id-25461.brockwell.irccloud.com) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * yghannam (~yghannam@0001f8aa.user.oftc.net) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * circ-user-nNWGw (~circuser-@50.46.225.207) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * _robbat21irssi (nobody@www2.orbis-terrarum.net) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * sbadia (~sbadia@marcellin.sebian.fr) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * rektide (~rektide@eldergods.com) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * real (~lalelu@invincible.the-real.org) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * philips (~philips@ec2-54-196-103-51.compute-1.amazonaws.com) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * yanzheng (~zhyan@182.139.20.134) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * dustinm` (~dustinm`@2607:5300:100:200::160d) Quit (resistance.oftc.net weber.oftc.net)
[4:17] * rektide (~rektide@eldergods.com) has joined #ceph
[4:17] * sbadia (~sbadia@marcellin.sebian.fr) has joined #ceph
[4:17] * mdxi (~mdxi@50-199-109-154-static.hfc.comcastbusiness.net) has joined #ceph
[4:17] * Georgyo (~georgyo@shamm.as) has joined #ceph
[4:17] * dustinm` (~dustinm`@2607:5300:100:200::160d) has joined #ceph
[4:17] * andrewschoen (~andrewsch@50.56.86.195) has joined #ceph
[4:17] * ktdreyer (~kdreyer@polyp.adiemus.org) has joined #ceph
[4:17] * _are_ (~quassel@2a01:238:4325:ca00:f065:c93c:f967:9285) has joined #ceph
[4:17] * real (~lalelu@invincible.the-real.org) has joined #ceph
[4:17] * dalegaard-39554 (~dalegaard@vps.devrandom.dk) has joined #ceph
[4:17] * Bosse (~bosse@rifter2.klykken.com) has joined #ceph
[4:17] * lbarfield (~logan@ralvm.saturne.in) has joined #ceph
[4:17] * bjornar (~bjornar@109.247.131.38) has joined #ceph
[4:17] * essjayhch (sid79416@id-79416.ealing.irccloud.com) has joined #ceph
[4:17] * zaitcev (~zaitcev@2001:558:6001:10:61d7:f51f:def8:4b0f) has joined #ceph
[4:18] * martineg (~martin@shell01.copyleft.no) has joined #ceph
[4:18] * gsilvis (~andovan@c-73-159-49-122.hsd1.ma.comcast.net) has joined #ceph
[4:18] * destrudo (~destrudo@64.142.74.180) has joined #ceph
[4:18] * circ-user-nNWGw (~circuser-@50.46.225.207) has joined #ceph
[4:18] * JohnPreston78 (sid31393@id-31393.charlton.irccloud.com) has joined #ceph
[4:18] * MK_FG (~MK_FG@188.226.62.174) has joined #ceph
[4:18] * _robbat2|irssi (nobody@www2.orbis-terrarum.net) has joined #ceph
[4:18] <kuroneko> MACscr|lappy: my experience suggests (this is not at all authorative) that the OSDs will not renumber.
[4:18] * zenpac (~zenpac3@66.55.33.66) has joined #ceph
[4:18] * MrHeavy (~MrHeavy@pool-108-54-190-117.nycmny.fios.verizon.net) has joined #ceph
[4:18] * marrusl (~mark@cpe-67-247-9-253.nyc.res.rr.com) has joined #ceph
[4:18] * xdeller (~xdeller@h195-91-128-218.ln.rinet.ru) has joined #ceph
[4:18] * kamalmarhubi (sid26581@id-26581.highgate.irccloud.com) has joined #ceph
[4:18] * ska (~skatinolo@cpe-173-174-111-177.austin.res.rr.com) has joined #ceph
[4:18] * Jahkeup (Jahkeup@gemini.ca.us.panicbnc.net) has joined #ceph
[4:18] * yghannam (~yghannam@0001f8aa.user.oftc.net) has joined #ceph
[4:18] * ivotron (uid25461@id-25461.brockwell.irccloud.com) has joined #ceph
[4:18] * Tene (~tene@173.13.139.236) has joined #ceph
[4:18] * evilrob00 (~evilrob00@cpe-72-179-3-209.austin.res.rr.com) has joined #ceph
[4:18] * _nick (~nick@zarquon.dischord.org) has joined #ceph
[4:18] * zz_hitsumabushi (~hitsumabu@175.184.30.148) has joined #ceph
[4:18] <MACscr|lappy> kuroneko: thanks!
[4:18] * pdrakeweb (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) has joined #ceph
[4:18] * JoeJulian (~JoeJulian@shared.gaealink.net) has joined #ceph
[4:18] * dmick (~dmick@206.169.83.146) has joined #ceph
[4:19] * philips (~philips@ec2-54-196-103-51.compute-1.amazonaws.com) has joined #ceph
[4:19] * yanzheng (~zhyan@182.139.20.134) has joined #ceph
[4:20] * lxo (~aoliva@lxo.user.oftc.net) Quit (Ping timeout: 480 seconds)
[4:21] * doppelgrau (~doppelgra@pd956d116.dip0.t-ipconnect.de) Quit (Quit: doppelgrau)
[4:21] * nils_ (~nils@doomstreet.collins.kg) Quit (Read error: Connection reset by peer)
[4:22] * nils_ (~nils@doomstreet.collins.kg) has joined #ceph
[4:25] * badone (~brad@CPE-121-215-241-179.static.qld.bigpond.net.au) Quit (Ping timeout: 480 seconds)
[4:26] * tuxcraft1r (~jelle@ebony.powercraft.nl) has joined #ceph
[4:26] * tuxcrafter (~jelle@ebony.powercraft.nl) Quit (Read error: Connection reset by peer)
[5:05] * MrBy3 (~jonas@85.115.12.132) Quit (Ping timeout: 480 seconds)
[5:11] * i_m (~ivan.miro@nat-5-carp.hcn-strela.ru) Quit (Ping timeout: 480 seconds)
[5:12] * georgem1 (~Adium@69-165-151-86.dsl.teksavvy.com) has joined #ceph
[5:18] * georgem (~Adium@69-165-162-64.dsl.teksavvy.com) Quit (Ping timeout: 480 seconds)
[5:18] * lucas (~Thunderbi@218.76.52.64) has joined #ceph
[5:30] * MACscr|lappy (~MACscrlap@2601:247:4102:c3ac:701e:c37e:7b42:7762) Quit (Ping timeout: 480 seconds)
[5:34] * Vacuum_ (~Vacuum@88.130.208.241) has joined #ceph
[5:41] * Vacuum__ (~Vacuum@88.130.222.14) Quit (Ping timeout: 480 seconds)
[5:50] * MentalRay (~MRay@107.171.161.165) Quit (Quit: This computer has gone to sleep)
[5:53] <m0zes> HEALTH_WARN 'cachepool' at/near target max; cache pool 'cachepool' with 10745GB at/near target max 350TB. any ideas why ceph seems to think my cache pool is full?
[5:54] <m0zes> using 0.94.2 on Centos 7.1, cache pool in front of a erasure coded pool, both pools on the same spinning disks.
[5:58] * lucas (~Thunderbi@218.76.52.64) Quit (Quit: lucas)
[6:04] * pai (~oftc-webi@43.224.129.49) has joined #ceph
[6:05] <pai> i am running a 4 node cluster,one of the server freuenyly showing osd as down and then as up its log says "log [WRN] : map e42784 wrongly marked me down"
[6:06] <pai> there are also other logs with "e42784 " changes to "e42794" how can i know what is causing this behaviour
[6:07] * linjan (~linjan@213.8.240.146) Quit (Ping timeout: 480 seconds)
[6:09] * DV_ (~veillard@2001:41d0:1:d478::1) Quit (Remote host closed the connection)
[6:13] * ira (~ira@c-71-233-225-22.hsd1.ma.comcast.net) Quit (Ping timeout: 480 seconds)
[6:18] <m0zes> pai: there is something that is causing the osd to be extremely slow in responding to reads/writes/heartbeats. sometimes this can mean you have an overloaded system, other times it can mean the disk that is getting marked down is beginning to fail.
[6:21] <m0zes> I've also seen fstrim being run on ssd osds cause that behavior and sometimes cause the osd to hit the suicide timeout. suicide timeout happens if i/o gets slow enough that the disk doesn't respond for 60+(?) seconds.
[6:23] * vata (~vata@cable-21.246.173-197.electronicbox.net) has joined #ceph
[6:23] <pai> m0zes : i dont have any data stored in this cluster,all disks are new (can be faulty) with 16 core servers.Anyway I am doing a health check on those disks .What are these "e42784" and "e42794" in logs
[6:23] * dyasny (~dyasny@104.158.34.71) Quit (Ping timeout: 480 seconds)
[6:24] * georgem1 (~Adium@69-165-151-86.dsl.teksavvy.com) Quit (Quit: Leaving.)
[6:26] <m0zes> those are probably in reference to the osdmap. the osdmap gets incremented on changes to the topology, i.e. an osd getting marked down.
[6:26] <m0zes> ceph -s will show the current counters for the various maps, among other things.
[6:59] * reed (~reed@75-101-54-131.dsl.static.fusionbroadband.com) Quit (Quit: Ex-Chat)
[7:04] * kefu (~kefu@114.92.102.166) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[7:29] * kefu (~kefu@114.92.102.166) has joined #ceph
[7:31] * wschulze (~wschulze@cpe-69-206-240-164.nyc.res.rr.com) Quit (Quit: Leaving.)
[7:31] * amote (~amote@1.39.14.141) has joined #ceph
[7:46] <pai> thanks m0zes
[7:48] <pai> its behaving normal now ,not sure what was the issue i rebooted that server...now there are no wrongly marked me down message.While doing /dev/zero of rbd device on client server i rebooted one of the host now the i/o is blocked in client,will it be able to cpmplete the blocked i/o
[7:49] <pai> 4 hosts,3 osd each with min and replica as 3
[8:03] * amote (~amote@1.39.14.141) Quit (Quit: Leaving)
[8:06] * kefu (~kefu@114.92.102.166) Quit (Max SendQ exceeded)
[8:07] * kefu (~kefu@114.92.102.166) has joined #ceph
[8:10] * kefu (~kefu@114.92.102.166) Quit (Max SendQ exceeded)
[8:10] * kefu (~kefu@114.92.102.166) has joined #ceph
[8:10] * mykola (~Mikolaj@91.225.202.121) has joined #ceph
[8:12] * wicope (~wicope@0001fd8a.user.oftc.net) has joined #ceph
[8:16] * dgbaley27 (~matt@c-67-176-93-83.hsd1.co.comcast.net) Quit (Remote host closed the connection)
[8:37] * oro (~oro@84-72-180-62.dclient.hispeed.ch) has joined #ceph
[8:38] * fridim_ (~fridim@56-198-190-109.dsl.ovh.fr) has joined #ceph
[8:40] * dopesong (~dopesong@78-60-74-130.static.zebra.lt) has joined #ceph
[8:41] * zaitcev (~zaitcev@2001:558:6001:10:61d7:f51f:def8:4b0f) Quit (Quit: Bye)
[8:49] * primechuck (~primechuc@86.188.131.210) has joined #ceph
[8:54] * pai (~oftc-webi@43.224.129.49) Quit (Quit: Page closed)
[9:18] * Nacer_ (~Nacer@2001:41d0:fe82:7200:58f1:b488:7091:af82) has joined #ceph
[9:18] * Nacer (~Nacer@203-206-190-109.dsl.ovh.fr) Quit (Read error: Connection reset by peer)
[9:20] * kefu (~kefu@114.92.102.166) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[9:52] * oro (~oro@84-72-180-62.dclient.hispeed.ch) Quit (Ping timeout: 480 seconds)
[9:55] * kefu (~kefu@114.92.102.166) has joined #ceph
[10:07] * kefu (~kefu@114.92.102.166) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[10:24] * bgleb (~bgleb@84.201.151.247-vpn.dhcp.yndx.net) has joined #ceph
[10:28] * kefu (~kefu@114.92.102.166) has joined #ceph
[10:30] * fridim_ (~fridim@56-198-190-109.dsl.ovh.fr) Quit (Ping timeout: 480 seconds)
[10:32] * bgleb (~bgleb@84.201.151.247-vpn.dhcp.yndx.net) Quit (Remote host closed the connection)
[10:34] * lofejndif (~lsqavnbok@162.216.46.24) has joined #ceph
[10:41] * fdmanana__ (~fdmanana@bl13-155-180.dsl.telepac.pt) has joined #ceph
[10:41] * stiopa (~stiopa@cpc73828-dals21-2-0-cust630.20-2.cable.virginm.net) has joined #ceph
[10:45] * kefu (~kefu@114.92.102.166) Quit (Max SendQ exceeded)
[10:47] * kefu (~kefu@114.92.102.166) has joined #ceph
[10:49] * kefu (~kefu@114.92.102.166) Quit (Max SendQ exceeded)
[10:50] * kefu (~kefu@114.92.102.166) has joined #ceph
[10:57] * cok (~chk@test.roskilde-festival.dk) has joined #ceph
[10:58] * cok (~chk@test.roskilde-festival.dk) has left #ceph
[10:59] * jcsp (~Adium@0001bf3a.user.oftc.net) Quit (Quit: Leaving.)
[11:00] * Sysadmin88 (~IceChat77@2.124.164.69) Quit (Quit: Hard work pays off in the future, laziness pays off now)
[11:01] * arbrandes (~arbrandes@201-95-1-93.dsl.telesp.net.br) has joined #ceph
[11:09] * arbrandes (~arbrandes@201-95-1-93.dsl.telesp.net.br) Quit (Ping timeout: 480 seconds)
[11:28] * kefu (~kefu@114.92.102.166) Quit (Ping timeout: 480 seconds)
[11:35] * badone (~brad@CPE-121-215-241-179.static.qld.bigpond.net.au) has joined #ceph
[11:37] * doppelgrau (~doppelgra@pd956d116.dip0.t-ipconnect.de) has joined #ceph
[11:38] * dopesong (~dopesong@78-60-74-130.static.zebra.lt) Quit (Remote host closed the connection)
[11:48] * nardial (~ls@dslb-088-076-092-027.088.076.pools.vodafone-ip.de) has joined #ceph
[11:52] * fdmanana__ (~fdmanana@bl13-155-180.dsl.telepac.pt) Quit (Ping timeout: 480 seconds)
[11:54] * sleinen (~Adium@84-72-160-233.dclient.hispeed.ch) has joined #ceph
[11:56] * kefu (~kefu@114.92.113.55) has joined #ceph
[11:58] * sleinen1 (~Adium@2001:620:0:69::100) has joined #ceph
[12:01] * dgurtner (~dgurtner@217-162-119-191.dynamic.hispeed.ch) has joined #ceph
[12:02] * sleinen (~Adium@84-72-160-233.dclient.hispeed.ch) Quit (Ping timeout: 480 seconds)
[12:04] * zviratko (~zviratko@241-73-239-109.cust.centrio.cz) Quit (Ping timeout: 480 seconds)
[12:13] * zviratko (~zviratko@241-73-239-109.cust.centrio.cz) has joined #ceph
[12:14] * kefu_ (~kefu@114.92.113.55) has joined #ceph
[12:17] * bgleb (~bgleb@94.19.146.224) has joined #ceph
[12:18] * Debesis (~0x@213.119.116.89.mobile.mezon.lt) has joined #ceph
[12:19] * bgleb_ (~bgleb@130.193.34.151-iva.dhcp.yndx.net) has joined #ceph
[12:19] * doppelgrau (~doppelgra@pd956d116.dip0.t-ipconnect.de) Quit (Quit: doppelgrau)
[12:20] * kefu (~kefu@114.92.113.55) Quit (Ping timeout: 480 seconds)
[12:25] * bgleb (~bgleb@94.19.146.224) Quit (Ping timeout: 480 seconds)
[12:30] * dgurtner (~dgurtner@217-162-119-191.dynamic.hispeed.ch) Quit (Ping timeout: 480 seconds)
[12:31] * bgleb_ (~bgleb@130.193.34.151-iva.dhcp.yndx.net) Quit (Remote host closed the connection)
[12:33] * kefu_ (~kefu@114.92.113.55) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[12:35] * Sysadmin88 (~IceChat77@2.124.164.69) has joined #ceph
[12:39] * dopesong (~dopesong@78-60-74-130.static.zebra.lt) has joined #ceph
[12:42] * Rens2Sea (~allenmelo@213.5.66.3) has joined #ceph
[12:47] * dopesong (~dopesong@78-60-74-130.static.zebra.lt) Quit (Ping timeout: 480 seconds)
[12:48] * linjan (~linjan@213.8.240.146) has joined #ceph
[12:48] * mykola (~Mikolaj@91.225.202.121) Quit (Quit: away)
[12:57] * nardial (~ls@dslb-088-076-092-027.088.076.pools.vodafone-ip.de) Quit (Quit: Leaving)
[12:58] * kefu (~kefu@114.92.113.55) has joined #ceph
[12:59] * daviddcc (~dcasier@84.197.151.77.rev.sfr.net) has joined #ceph
[12:59] * sep (~sep@95.62-50-191.enivest.net) Quit (Ping timeout: 480 seconds)
[13:05] * TMM (~hp@178-84-46-106.dynamic.upc.nl) has joined #ceph
[13:06] * badone (~brad@CPE-121-215-241-179.static.qld.bigpond.net.au) Quit (Ping timeout: 480 seconds)
[13:12] * Rens2Sea (~allenmelo@213.5.66.3) Quit ()
[13:13] * kefu (~kefu@114.92.113.55) Quit (Max SendQ exceeded)
[13:14] * nsoffer (~nsoffer@109.65.255.114) has joined #ceph
[13:17] * kefu (~kefu@114.92.113.55) has joined #ceph
[13:19] * bitserker (~toni@77.231.154.146) has joined #ceph
[13:21] * mookins (~mookins@induct3.lnk.telstra.net) Quit ()
[13:24] * vbellur (~vijay@50-206-204-8-static.hfc.comcastbusiness.net) Quit (Ping timeout: 480 seconds)
[13:26] * rotbeard (~redbeard@2a02:908:df10:d300:76f0:6dff:fe3b:994d) Quit (Quit: Verlassend)
[13:30] * Zethrok_ (~martin@95.154.26.34) Quit (Remote host closed the connection)
[13:37] * kefu (~kefu@114.92.113.55) Quit (Max SendQ exceeded)
[13:38] * kefu (~kefu@114.92.113.55) has joined #ceph
[13:41] * dopesong (~dopesong@78-60-74-130.static.zebra.lt) has joined #ceph
[13:49] * dopesong (~dopesong@78-60-74-130.static.zebra.lt) Quit (Ping timeout: 480 seconds)
[13:52] * lofejndif (~lsqavnbok@162.216.46.24) Quit (Quit: gone)
[13:52] * kefu (~kefu@114.92.113.55) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[14:06] * kefu (~kefu@114.92.113.55) has joined #ceph
[14:07] * overclk (~overclk@59.93.64.133) Quit (Ping timeout: 480 seconds)
[14:12] * fdmanana__ (~fdmanana@bl13-155-180.dsl.telepac.pt) has joined #ceph
[14:15] * n0x1d (~Revo84@h-213.61.149.100.host.de.colt.net) has joined #ceph
[14:17] * overclk (~overclk@117.208.191.198) has joined #ceph
[14:38] * fridim_ (~fridim@56-198-190-109.dsl.ovh.fr) has joined #ceph
[14:40] * dopesong (~dopesong@78-60-74-130.static.zebra.lt) has joined #ceph
[14:45] * n0x1d (~Revo84@9S0AABMC6.tor-irc.dnsbl.oftc.net) Quit ()
[14:46] * vbellur (~vijay@209.117.45.10) has joined #ceph
[14:46] * fdmanana__ (~fdmanana@bl13-155-180.dsl.telepac.pt) Quit (Ping timeout: 480 seconds)
[15:04] * nhm (~nhm@184-97-242-33.mpls.qwest.net) has joined #ceph
[15:04] * ChanServ sets mode +o nhm
[15:13] * dopesong_ (~dopesong@lb1.mailer.data.lt) has joined #ceph
[15:14] * yanzheng (~zhyan@182.139.20.134) Quit (Quit: This computer has gone to sleep)
[15:14] * vbellur (~vijay@209.117.45.10) Quit (Ping timeout: 480 seconds)
[15:17] * Heliwr (~hassifa@46.166.188.211) has joined #ceph
[15:19] * dopesong (~dopesong@78-60-74-130.static.zebra.lt) Quit (Ping timeout: 480 seconds)
[15:25] * overclk (~overclk@117.208.191.198) Quit (Ping timeout: 480 seconds)
[15:33] * overclk (~overclk@117.242.6.216) has joined #ceph
[15:39] * overclk (~overclk@117.242.6.216) Quit (Quit: Leaving)
[15:43] * kefu (~kefu@114.92.113.55) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[15:47] * Heliwr (~hassifa@9S0AABMED.tor-irc.dnsbl.oftc.net) Quit ()
[15:56] * derjohn_mob (~aj@b2b-94-79-172-98.unitymedia.biz) has joined #ceph
[15:56] * kefu (~kefu@114.92.113.55) has joined #ceph
[15:59] * kefu (~kefu@114.92.113.55) Quit (Max SendQ exceeded)
[16:00] * kefu (~kefu@114.92.113.55) has joined #ceph
[16:19] * kefu (~kefu@114.92.113.55) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[16:29] * madkiss (~madkiss@089144198222.atnat0007.highway.a1.net) has joined #ceph
[16:33] * fdmanana__ (~fdmanana@bl13-155-180.dsl.telepac.pt) has joined #ceph
[16:36] * rcfighter (~Jamana@static.7.11.9.176.clients.your-server.de) has joined #ceph
[16:39] * yanzheng (~zhyan@182.139.20.134) has joined #ceph
[16:43] * wschulze (~wschulze@cpe-69-206-240-164.nyc.res.rr.com) has joined #ceph
[16:44] * i_m (~ivan.miro@nat-5-carp.hcn-strela.ru) has joined #ceph
[16:46] * yanzheng (~zhyan@182.139.20.134) Quit (Quit: This computer has gone to sleep)
[16:54] * alexbligh1 (~alexbligh@89-16-176-215.no-reverse-dns-set.bytemark.co.uk) has left #ceph
[17:01] * rcfighter (~Jamana@static.7.11.9.176.clients.your-server.de) Quit (Ping timeout: 480 seconds)
[17:02] * kefu (~kefu@114.92.113.55) has joined #ceph
[17:04] * kefu (~kefu@114.92.113.55) Quit ()
[17:07] * bitserker (~toni@77.231.154.146) Quit (Quit: Leaving.)
[17:07] * bitserker (~toni@77.231.154.146) has joined #ceph
[17:09] * dyasny (~dyasny@198.251.57.154) has joined #ceph
[17:12] * Kingrat (~shiny@2605:a000:161a:c022:c072:7874:e99:8ad0) Quit (Ping timeout: 480 seconds)
[17:19] * yanzheng (~zhyan@182.139.20.134) has joined #ceph
[17:20] * ira (~ira@c-71-233-225-22.hsd1.ma.comcast.net) has joined #ceph
[17:20] * Kingrat (~shiny@2605:a000:161a:c022:a8c7:69e6:7e18:c751) has joined #ceph
[17:26] * nhm_ (~nhm@184-97-242-33.mpls.qwest.net) has joined #ceph
[17:27] * nhm (~nhm@184-97-242-33.mpls.qwest.net) Quit (Ping timeout: 480 seconds)
[17:35] * derjohn_mob (~aj@b2b-94-79-172-98.unitymedia.biz) Quit (Ping timeout: 480 seconds)
[17:38] * daviddcc (~dcasier@84.197.151.77.rev.sfr.net) Quit (Ping timeout: 480 seconds)
[17:51] * fdmanana__ (~fdmanana@bl13-155-180.dsl.telepac.pt) Quit (Ping timeout: 480 seconds)
[17:58] * nhm (~nhm@184-97-242-33.mpls.qwest.net) has joined #ceph
[17:58] * ChanServ sets mode +o nhm
[18:00] * nhm_ (~nhm@184-97-242-33.mpls.qwest.net) Quit (Ping timeout: 480 seconds)
[18:01] * yanzheng (~zhyan@182.139.20.134) Quit (Quit: This computer has gone to sleep)
[18:06] * bitserker (~toni@77.231.154.146) Quit (Quit: Leaving.)
[18:07] * bitserker (~toni@77.231.154.146) has joined #ceph
[18:15] * owasserm (~owasserm@52D9864F.cm-11-1c.dynamic.ziggo.nl) Quit (Quit: Ex-Chat)
[18:26] * kefu (~kefu@114.92.113.55) has joined #ceph
[18:44] * stiopa (~stiopa@cpc73828-dals21-2-0-cust630.20-2.cable.virginm.net) Quit (Ping timeout: 480 seconds)
[18:46] * doppelgrau (~doppelgra@pd956d116.dip0.t-ipconnect.de) has joined #ceph
[18:54] * mykola (~Mikolaj@91.225.202.121) has joined #ceph
[19:02] * kefu (~kefu@114.92.113.55) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[19:03] * derjohn_mob (~aj@x590d537b.dyn.telefonica.de) has joined #ceph
[19:11] * georgem (~Adium@69-165-151-86.dsl.teksavvy.com) has joined #ceph
[19:25] * georgem (~Adium@69-165-151-86.dsl.teksavvy.com) Quit (Quit: Leaving.)
[19:26] * qybl (~foo@kamino.krzbff.de) Quit (Quit: WeeChat 1.1.1)
[19:30] * ade (~abradshaw@dslb-088-075-017-254.088.075.pools.vodafone-ip.de) has joined #ceph
[19:31] * ade (~abradshaw@dslb-088-075-017-254.088.075.pools.vodafone-ip.de) Quit ()
[19:36] * qybl (~foo@kamino.krzbff.de) has joined #ceph
[19:38] * derjohn_mob (~aj@x590d537b.dyn.telefonica.de) Quit (Ping timeout: 480 seconds)
[19:48] * derjohn_mob (~aj@x590d537b.dyn.telefonica.de) has joined #ceph
[20:18] * dopesong_ (~dopesong@lb1.mailer.data.lt) Quit (Remote host closed the connection)
[20:19] * dopesong (~dopesong@78-60-74-130.static.zebra.lt) has joined #ceph
[20:19] * dopesong (~dopesong@78-60-74-130.static.zebra.lt) Quit (Remote host closed the connection)
[20:20] * doppelgrau (~doppelgra@pd956d116.dip0.t-ipconnect.de) Quit (Quit: doppelgrau)
[20:20] * ira (~ira@c-71-233-225-22.hsd1.ma.comcast.net) Quit (Ping timeout: 480 seconds)
[20:30] * georgem (~Adium@69-165-151-86.dsl.teksavvy.com) has joined #ceph
[20:32] * bitserker (~toni@77.231.154.146) Quit (Quit: Leaving.)
[20:32] * hifi1 (~csharp@9S0AABMMA.tor-irc.dnsbl.oftc.net) has joined #ceph
[20:32] * bitserker (~toni@77.231.154.146) has joined #ceph
[20:59] * georgem (~Adium@69-165-151-86.dsl.teksavvy.com) Quit (Quit: Leaving.)
[21:02] * hifi1 (~csharp@9S0AABMMA.tor-irc.dnsbl.oftc.net) Quit ()
[21:07] * bitserker (~toni@77.231.154.146) Quit (Quit: Leaving.)
[21:07] * bitserker (~toni@77.231.154.146) has joined #ceph
[21:24] * bitserker (~toni@77.231.154.146) Quit (Quit: Leaving.)
[21:24] * bitserker (~toni@77.231.154.146) has joined #ceph
[21:46] <romel> hi guys. i have a simple two node ceph setup (two osds and one mon on each machine). servers are interconnected via 1Gbps private network. the problem is that i'm experiencing pretty strange write throughput instablility. here is a rados output: http://pastebin.com/vHE7jqu7
[21:47] <romel> rados is being performed at the 3rd server which is also a bare metal machine connected via 1Gbps public network
[21:48] <romel> tested network connectivity using iperf, it constantly shows 900-1000 Mbps
[21:49] <romel> here is a configuration file: http://pastebin.com/xMb6ydgB . journal is placed on a separate ssd disks for both machines.
[21:50] <TheSov2> romel, your first mistake is you need an odd number of monitors
[21:50] <romel> i can tell further details if needed but what i'm asking for is to point me a direction of investigation
[21:50] <TheSov2> im looking now
[21:50] <TheSov2> show me your osd tree
[21:51] <romel> TheSov2: yes, i know but can this cause such throughput drops?
[21:51] <romel> sure
[21:51] <TheSov2> yes if your monitors are slow to write it slows the whole cluster
[21:51] <TheSov2> monitor database lies in /var
[21:51] <TheSov2> if you are sharing disk for osd/monitor it will cause delays
[21:52] <TheSov2> a "production" setup is to have monitors on their own
[21:52] <romel> here is a tree http://pastebin.com/MZiqq0yN
[21:52] <TheSov2> u using debian or redhat?
[21:53] <romel> all three hosts are runing debian wheezy with backported 3.16 kernel
[21:53] <TheSov2> can u show me the lsblk of one of the nodes
[21:53] <romel> sure
[21:54] <romel> http://pastebin.com/Knq9yNxn it's the same for both nodes
[21:54] <TheSov2> sdc1 is a journal?
[21:54] <TheSov2> err
[21:54] <TheSov2> nevermind
[21:54] <TheSov2> im an ididot
[21:55] <TheSov2> well your setup looks good
[21:55] <romel> it's a sdd1 and sdd2 - two pieces, one for each osd
[21:55] <TheSov2> is that ssd?
[21:55] <TheSov2> or rust
[21:56] <romel> yes, it's ssd
[21:56] <TheSov2> last question
[21:56] <TheSov2> did u turn off writecaching for ssd and rust drives?
[21:56] <romel> i'm seeing two kworker threads using over 99% of IO during tests
[21:56] <romel> i think i didn't
[21:56] <TheSov2> that can cause problems
[21:57] <TheSov2> http://ceph.com/docs/master/rados/configuration/filesystem-recommendations/
[21:57] <TheSov2> that will make your numbers smaller but more stable
[21:58] <romel> i'm reading now. will try soon
[21:58] <romel> thank you very much
[21:58] <TheSov2> no problem
[21:59] <TheSov2> but other than that, your setup looks good, but i would setup a 3rd monitor as soon as you can
[21:59] <TheSov2> fyi if you ever build a large cluster, the speed of the monitors will have in impact on the speed of the cluster
[21:59] <romel> yea, that's my primary plan for now :)
[22:03] * mykola (~Mikolaj@91.225.202.121) Quit (Quit: away)
[22:25] * rotbeard (~redbeard@2a02:908:df10:d300:76f0:6dff:fe3b:994d) has joined #ceph
[22:53] * MentalRay (~MRay@107.171.161.165) has joined #ceph
[22:59] * yghannam (~yghannam@0001f8aa.user.oftc.net) Quit (Quit: Leaving)
[23:13] * stiopa (~stiopa@cpc73828-dals21-2-0-cust630.20-2.cable.virginm.net) has joined #ceph
[23:16] * bitserker (~toni@77.231.154.146) Quit (Quit: Leaving.)
[23:16] * bitserker (~toni@77.231.154.146) has joined #ceph
[23:17] * daviddcc (~dcasier@ADijon-653-1-192-159.w90-39.abo.wanadoo.fr) has joined #ceph
[23:19] * bitserker (~toni@77.231.154.146) Quit ()
[23:20] * bitserker (~toni@77.231.154.146) has joined #ceph
[23:23] * wicope (~wicope@0001fd8a.user.oftc.net) Quit (Remote host closed the connection)
[23:26] * Spessu (~Diablothe@tor-exit.squirrel.theremailer.net) has joined #ceph
[23:27] * ira (~ira@c-71-233-225-22.hsd1.ma.comcast.net) has joined #ceph
[23:31] * cholcombe (~chris@c-73-180-29-35.hsd1.or.comcast.net) Quit (Ping timeout: 480 seconds)
[23:38] * logan (~a@63.143.49.103) has joined #ceph
[23:39] * bgleb (~bgleb@94.19.146.224) has joined #ceph
[23:40] * fridim_ (~fridim@56-198-190-109.dsl.ovh.fr) Quit (Ping timeout: 480 seconds)
[23:45] * linjan (~linjan@213.8.240.146) Quit (Ping timeout: 480 seconds)
[23:53] * sleinen1 (~Adium@2001:620:0:69::100) Quit (Ping timeout: 480 seconds)
[23:54] * shawniverson (~oftc-webi@199-204-84-217.nwcsinaa.metronetinc.net) has joined #ceph
[23:56] * Spessu (~Diablothe@9S0AABMQF.tor-irc.dnsbl.oftc.net) Quit ()
[23:57] <shawniverson> I am trying out ceph. Previously using drbd but kept experiencing data integrity problems after node failure. I have a 3 node setup, but sadly running into integrity problems when I kill a node...
[23:59] <shawniverson> have rbd cache = false and rbd cache max dirty = 0
[23:59] <shawniverson> iscsi layer is also write through with no cache (using scst)

These logs were automatically created by CephLogBot on irc.oftc.net using the Java IRC LogBot.