#ceph IRC Log

Index

IRC Log for 2016-09-06

Timestamps are in GMT/BST.

[11:40] -reticulum.oftc.net- *** Looking up your hostname...
[11:40] -reticulum.oftc.net- *** Checking Ident
[11:40] -reticulum.oftc.net- *** Found your hostname
[11:40] -reticulum.oftc.net- *** No Ident response
[11:40] * CephLogBot (~PircBot@rockbox.widodh.nl) has joined #ceph
[11:40] * Topic is 'http://ceph.com/get || dev channel #ceph-devel || test lab channel #sepia'
[11:40] * Set by ChanServ!services@services.oftc.net on Wed Aug 24 19:45:50 CEST 2016
[11:40] <ivve> ceph osd pool get ssd_cache cache_min_evict_age
[11:40] <ivve> cache_min_evict_age: 300
[11:41] * karnan (~karnan@121.244.87.117) Quit (Ping timeout: 480 seconds)
[11:41] <Be-El> and the ratios?
[11:43] <ivve> its wierd
[11:43] <ivve> ceph osd pool get ssd_cache cache_target_full_ratio
[11:43] <ivve> cache_target_full_ratio: 0
[11:43] <Be-El> (off for lunch now)
[11:43] <ivve> ceph osd pool get ssd_cache cache_target_dirty_ratio
[11:43] <ivve> cache_target_dirty_ratio: 0
[11:44] <ivve> okay
[11:44] <ivve> ill go for lunch too then :)
[11:44] <Be-El> and try ratios != 0
[11:44] <ivve> yeah i set it to 0.8
[11:45] <ivve> however
[11:45] <ivve> everything works
[11:45] <ivve> just not listing
[11:45] <ivve> soooo wierd
[11:45] <ivve> lunch now :)
[11:46] * chrishuen (~oftc-webi@141.22.31.103) has joined #ceph
[11:46] * seosepa (~sepa@aperture.GLaDOS.info) Quit (Quit: No Ping reply in 90 seconds.)
[11:46] <chrishuen> Hi good folks at CEPH,
[11:48] * seosepa (~sepa@aperture.GLaDOS.info) has joined #ceph
[11:49] * derjohn_mob (~aj@fw.gkh-setu.de) has joined #ceph
[11:51] <chrishuen> Hi have a ceph-mon problem. My cluster stopped working after I had to restart the machines, which it is installed on. My setup includes 3 hosts, one of which is currently down, but the cluster remained healthy since the other two could build a quorum just fine. No I restarted the hosts, because of a planned power outtage and the monitor on my 2nd node won't come up again. As a result the OSD daemons won't start either (naturally). My ceph-mon log reads
[11:51] <chrishuen> "2016-09-06 11:15:30.237519 7f8aeb1eb880 -1 error opening mon data directory at '/var/lib/ceph/mon/ceph-lanai': (22) Invalid argument 2016-09-06 11:22:54.777162 7f9f7411e880 0 ceph version 9.2.0 (bb2ecea240f3a1d525bcb35670cb07bd1f0ca299), process ceph-mon, pid 11486" Additionally I get a 'ceph-mon[2011]: Corruption: checksum mismatch' message, when trying to start it manually. I am running CEPH 9.2.0 on CentOS 7a and installed it via the Quick Start Gu
[11:51] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:4d30:1cb6:3a49:7398) Quit (Ping timeout: 480 seconds)
[11:51] <chrishuen> lp would be greatly appreciated!
[11:51] * nardial (~ls@p5DC068C4.dip0.t-ipconnect.de) has joined #ceph
[11:53] * karnan (~karnan@125.16.34.66) has joined #ceph
[11:54] * rotbeard (~redbeard@185.32.80.238) has joined #ceph
[11:56] * ashah (~ashah@121.244.87.117) has joined #ceph
[12:00] * swami2 (~swami@49.38.1.183) has joined #ceph
[12:00] * swami1 (~swami@49.38.1.183) Quit (Ping timeout: 480 seconds)
[12:02] * OODavo (~PuyoDead@213.61.149.100) has joined #ceph
[12:03] * derjohn_mob (~aj@fw.gkh-setu.de) Quit (Ping timeout: 480 seconds)
[13:34] -reticulum.oftc.net- *** Looking up your hostname...
[13:34] -reticulum.oftc.net- *** Checking Ident
[13:34] -reticulum.oftc.net- *** Couldn't look up your hostname
[13:34] -reticulum.oftc.net- *** No Ident response
[13:34] -reticulum.oftc.net- *** Looking up your hostname...
[13:34] -reticulum.oftc.net- *** Checking Ident
[13:34] -reticulum.oftc.net- *** Couldn't look up your hostname
[13:34] -reticulum.oftc.net- *** No Ident response
[13:34] -reticulum.oftc.net- *** Looking up your hostname...
[13:34] -reticulum.oftc.net- *** Checking Ident
[13:34] -reticulum.oftc.net- *** Couldn't look up your hostname
[13:35] -reticulum.oftc.net- *** No Ident response
[13:35] -reticulum.oftc.net- *** Looking up your hostname...
[13:35] -reticulum.oftc.net- *** Checking Ident
[13:35] -reticulum.oftc.net- *** Couldn't look up your hostname
[13:35] -reticulum.oftc.net- *** No Ident response
[13:35] -liquid.oftc.net- *** Looking up your hostname...
[13:35] -liquid.oftc.net- *** Checking Ident
[13:35] -liquid.oftc.net- *** Couldn't look up your hostname
[13:35] -liquid.oftc.net- *** No Ident response
[13:35] -dacia.oftc.net- *** Looking up your hostname...
[13:35] -dacia.oftc.net- *** Checking Ident
[13:35] -dacia.oftc.net- *** Couldn't look up your hostname
[13:35] -dacia.oftc.net- *** No Ident response
[13:35] -dacia.oftc.net- *** Looking up your hostname...
[13:35] -dacia.oftc.net- *** Checking Ident
[13:35] -dacia.oftc.net- *** Couldn't look up your hostname
[13:35] -dacia.oftc.net- *** No Ident response
[13:35] -reticulum.oftc.net- *** Looking up your hostname...
[13:35] -reticulum.oftc.net- *** Checking Ident
[13:35] -reticulum.oftc.net- *** Couldn't look up your hostname
[13:36] -reticulum.oftc.net- *** No Ident response
[13:36] -reticulum.oftc.net- *** Looking up your hostname...
[13:36] -reticulum.oftc.net- *** Checking Ident
[13:36] -reticulum.oftc.net- *** Couldn't look up your hostname
[13:36] -reticulum.oftc.net- *** No Ident response
[13:36] -reticulum.oftc.net- *** Looking up your hostname...
[13:36] -reticulum.oftc.net- *** Checking Ident
[13:36] -reticulum.oftc.net- *** Couldn't look up your hostname
[13:36] -reticulum.oftc.net- *** No Ident response
[13:36] -dacia.oftc.net- *** Looking up your hostname...
[13:36] -dacia.oftc.net- *** Checking Ident
[13:36] -dacia.oftc.net- *** Couldn't look up your hostname
[13:36] -dacia.oftc.net- *** No Ident response
[13:36] -liquid.oftc.net- *** Looking up your hostname...
[13:36] -liquid.oftc.net- *** Checking Ident
[13:36] -liquid.oftc.net- *** Couldn't look up your hostname
[13:36] -liquid.oftc.net- *** No Ident response
[13:36] -reticulum.oftc.net- *** Looking up your hostname...
[13:36] -reticulum.oftc.net- *** Checking Ident
[13:36] -reticulum.oftc.net- *** Couldn't look up your hostname
[13:37] -reticulum.oftc.net- *** No Ident response
[13:37] -reticulum.oftc.net- *** Looking up your hostname...
[13:37] -reticulum.oftc.net- *** Checking Ident
[13:37] -reticulum.oftc.net- *** Couldn't look up your hostname
[13:37] -reticulum.oftc.net- *** No Ident response
[13:37] -reticulum.oftc.net- *** Looking up your hostname...
[13:37] -reticulum.oftc.net- *** Checking Ident
[13:37] -reticulum.oftc.net- *** Couldn't look up your hostname
[13:37] -reticulum.oftc.net- *** No Ident response
[13:37] -reticulum.oftc.net- *** Looking up your hostname...
[13:37] -reticulum.oftc.net- *** Checking Ident
[13:37] -reticulum.oftc.net- *** Couldn't look up your hostname
[13:37] -reticulum.oftc.net- *** No Ident response
[13:37] -reticulum.oftc.net- *** Looking up your hostname...
[13:37] -reticulum.oftc.net- *** Checking Ident
[13:37] -reticulum.oftc.net- *** Couldn't look up your hostname
[13:37] -reticulum.oftc.net- *** No Ident response
[13:37] -reticulum.oftc.net- *** Looking up your hostname...
[13:37] -reticulum.oftc.net- *** Checking Ident
[13:37] -reticulum.oftc.net- *** Couldn't look up your hostname
[13:38] -reticulum.oftc.net- *** No Ident response
[13:38] -reticulum.oftc.net- *** Looking up your hostname...
[13:38] -reticulum.oftc.net- *** Checking Ident
[13:38] -reticulum.oftc.net- *** Couldn't look up your hostname
[13:38] -reticulum.oftc.net- *** No Ident response
[13:39] -reticulum.oftc.net- *** Looking up your hostname...
[13:39] -reticulum.oftc.net- *** Checking Ident
[13:39] -reticulum.oftc.net- *** Couldn't look up your hostname
[13:40] -reticulum.oftc.net- *** No Ident response
[13:40] -liquid.oftc.net- *** Looking up your hostname...
[13:40] -liquid.oftc.net- *** Checking Ident
[13:40] -liquid.oftc.net- *** Couldn't look up your hostname
[13:40] -liquid.oftc.net- *** No Ident response
[13:40] -liquid.oftc.net- *** Looking up your hostname...
[13:40] -liquid.oftc.net- *** Checking Ident
[13:40] -liquid.oftc.net- *** Couldn't look up your hostname
[13:40] -liquid.oftc.net- *** No Ident response
[13:40] -liquid.oftc.net- *** Looking up your hostname...
[13:40] -liquid.oftc.net- *** Checking Ident
[13:40] -liquid.oftc.net- *** Couldn't look up your hostname
[13:40] -liquid.oftc.net- *** No Ident response
[13:40] -dacia.oftc.net- *** Looking up your hostname...
[13:40] -dacia.oftc.net- *** Checking Ident
[13:40] -dacia.oftc.net- *** Couldn't look up your hostname
[13:40] -dacia.oftc.net- *** No Ident response
[13:40] -liquid.oftc.net- *** Looking up your hostname...
[13:40] -liquid.oftc.net- *** Checking Ident
[13:40] -liquid.oftc.net- *** Couldn't look up your hostname
[13:41] -liquid.oftc.net- *** No Ident response
[13:41] -liquid.oftc.net- *** Looking up your hostname...
[13:41] -liquid.oftc.net- *** Checking Ident
[13:41] -liquid.oftc.net- *** Couldn't look up your hostname
[13:41] -liquid.oftc.net- *** No Ident response
[13:41] -liquid.oftc.net- *** Looking up your hostname...
[13:41] -liquid.oftc.net- *** Checking Ident
[13:41] -liquid.oftc.net- *** Couldn't look up your hostname
[13:41] -liquid.oftc.net- *** No Ident response
[13:41] -dacia.oftc.net- *** Looking up your hostname...
[13:41] -dacia.oftc.net- *** Checking Ident
[13:41] -dacia.oftc.net- *** Couldn't look up your hostname
[13:41] -dacia.oftc.net- *** No Ident response
[13:41] -liquid.oftc.net- *** Looking up your hostname...
[13:41] -liquid.oftc.net- *** Checking Ident
[13:41] -liquid.oftc.net- *** Couldn't look up your hostname
[13:41] -liquid.oftc.net- *** No Ident response
[13:41] -liquid.oftc.net- *** Looking up your hostname...
[13:41] -liquid.oftc.net- *** Checking Ident
[13:41] -liquid.oftc.net- *** Couldn't look up your hostname
[13:42] -liquid.oftc.net- *** No Ident response
[13:42] -reticulum.oftc.net- *** Looking up your hostname...
[13:42] -reticulum.oftc.net- *** Checking Ident
[13:42] -reticulum.oftc.net- *** Couldn't look up your hostname
[13:42] -reticulum.oftc.net- *** No Ident response
[13:42] -reticulum.oftc.net- *** Looking up your hostname...
[13:42] -reticulum.oftc.net- *** Checking Ident
[13:42] -reticulum.oftc.net- *** Couldn't look up your hostname
[13:42] -reticulum.oftc.net- *** No Ident response
[13:42] -reticulum.oftc.net- *** Looking up your hostname...
[13:42] -reticulum.oftc.net- *** Checking Ident
[13:42] -reticulum.oftc.net- *** Couldn't look up your hostname
[13:42] -reticulum.oftc.net- *** No Ident response
[13:42] -reticulum.oftc.net- *** Looking up your hostname...
[13:42] -reticulum.oftc.net- *** Checking Ident
[13:42] -reticulum.oftc.net- *** Couldn't look up your hostname
[13:42] -reticulum.oftc.net- *** No Ident response
[13:42] -liquid.oftc.net- *** Looking up your hostname...
[13:42] -liquid.oftc.net- *** Checking Ident
[13:42] -liquid.oftc.net- *** Couldn't look up your hostname
[13:43] -liquid.oftc.net- *** No Ident response
[13:43] -liquid.oftc.net- *** Looking up your hostname...
[13:43] -liquid.oftc.net- *** Checking Ident
[13:43] -liquid.oftc.net- *** Couldn't look up your hostname
[13:43] -liquid.oftc.net- *** No Ident response
[13:43] * Disconnected.
[13:53] -liquid.oftc.net- *** Looking up your hostname...
[13:53] -liquid.oftc.net- *** Checking Ident
[13:53] -liquid.oftc.net- *** Couldn't look up your hostname
[13:53] -liquid.oftc.net- *** No Ident response
[13:53] * Disconnected.
[13:58] -dacia.oftc.net- *** Looking up your hostname...
[13:58] -dacia.oftc.net- *** Checking Ident
[13:58] -dacia.oftc.net- *** Couldn't look up your hostname
[13:58] -dacia.oftc.net- *** No Ident response
[13:58] * Disconnected.
[14:03] -dacia.oftc.net- *** Looking up your hostname...
[14:03] -dacia.oftc.net- *** Checking Ident
[14:03] -dacia.oftc.net- *** No Ident response
[14:03] -dacia.oftc.net- *** Found your hostname
[14:03] * Disconnected.
[14:36] -reticulum.oftc.net- *** Looking up your hostname...
[14:36] -reticulum.oftc.net- *** Checking Ident
[14:36] -reticulum.oftc.net- *** No Ident response
[14:36] -reticulum.oftc.net- *** Couldn't look up your hostname
[14:36] * CephLogBot (~PircBot@185.66.248.215) has joined #ceph
[14:36] * Topic is 'http://ceph.com/get || dev channel #ceph-devel || test lab channel #sepia'
[14:36] * Set by ChanServ!services@services.oftc.net on Wed Aug 24 19:45:50 CEST 2016
[14:38] * sebastian-w_ (~quassel@212.218.8.139) has joined #ceph
[14:39] * salwasser (~Adium@73.114.26.129) has joined #ceph
[14:39] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) Quit (Remote host closed the connection)
[14:39] * swami1 (~swami@49.38.1.183) has joined #ceph
[14:39] * sebastian-w (~quassel@212.218.8.139) Quit (Ping timeout: 480 seconds)
[14:41] * salwasser (~Adium@73.114.26.129) Quit ()
[14:41] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) has joined #ceph
[14:41] * sleinen1 (~Adium@2001:620:0:82::100) has left #ceph
[14:42] * swami2 (~swami@49.38.1.183) Quit (Ping timeout: 480 seconds)
[14:43] * EinstCrazy (~EinstCraz@58.39.76.12) has joined #ceph
[14:44] * valeech (~valeech@pool-96-247-203-33.clppva.fios.verizon.net) Quit (Quit: valeech)
[14:45] <cnf> i should try getting my 1 node S3 store going again...
[14:47] * derjohn_mob (~aj@46.189.28.53) has joined #ceph
[14:49] * vimal (~vikumar@121.244.87.116) Quit (Quit: Leaving)
[14:50] * srk (~Siva@cpe-70-113-23-93.austin.res.rr.com) has joined #ceph
[14:52] * nils_ (~nils_@doomstreet.collins.kg) has joined #ceph
[14:52] * bara (~bara@nat-pool-brq-t.redhat.com) Quit (Quit: Bye guys! (??????????????????? ?????????)
[14:52] * nils_ (~nils_@doomstreet.collins.kg) Quit ()
[14:56] * bara (~bara@213.175.37.12) has joined #ceph
[14:58] * morse (~morse@supercomputing.univpm.it) has joined #ceph
[14:59] * ledgr_ (~ledgr@84.15.179.174) has joined #ceph
[14:59] * ledgr_ (~ledgr@84.15.179.174) Quit (Remote host closed the connection)
[15:00] * ledgr_ (~ledgr@88-119-196-104.static.zebra.lt) has joined #ceph
[15:00] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) Quit (Ping timeout: 480 seconds)
[15:01] * nils_ (~nils_@doomstreet.collins.kg) has joined #ceph
[15:03] * krypto (~krypto@G68-90-105-157.sbcis.sbc.com) has joined #ceph
[15:06] * rraja (~rraja@121.244.87.117) Quit (Ping timeout: 480 seconds)
[15:08] * neurodrone_ (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) has joined #ceph
[15:11] * srk (~Siva@cpe-70-113-23-93.austin.res.rr.com) Quit (Read error: Connection reset by peer)
[15:12] * georgem (~Adium@206.108.127.16) has joined #ceph
[15:13] * srk (~Siva@cpe-70-113-23-93.austin.res.rr.com) has joined #ceph
[15:18] * brad_mssw (~brad@66.129.88.50) has joined #ceph
[15:18] * rraja (~rraja@125.16.34.66) has joined #ceph
[15:21] -liquid.oftc.net- *** Looking up your hostname...
[15:21] -liquid.oftc.net- *** Checking Ident
[15:21] -liquid.oftc.net- *** No Ident response
[15:21] -liquid.oftc.net- *** Found your hostname
[15:21] * CephLogBot (~PircBot@ceph-irc-logs.widodh.nl) has joined #ceph
[15:21] * Topic is 'http://ceph.com/get || dev channel #ceph-devel || test lab channel #sepia'
[15:21] * Set by ChanServ!services@services.oftc.net on Wed Aug 24 19:45:50 CEST 2016
[15:22] * danieagle (~Daniel@200-171-231-229.customer.telesp.net.br) has joined #ceph
[15:22] * dbbyleo (~dbbyleo@50-198-202-93-static.hfc.comcastbusiness.net) has joined #ceph
[15:23] * squizzi (~squizzi@107.13.237.240) has joined #ceph
[15:26] * F|1nt (~F|1nt@host37-211.lan-isdn.imaginet.fr) has joined #ceph
[15:27] * dbbyleo (~dbbyleo@50-198-202-93-static.hfc.comcastbusiness.net) has left #ceph
[15:27] * kefu (~kefu@114.92.125.128) has joined #ceph
[15:34] * ron-slc (~Ron@173-165-129-118-utah.hfc.comcastbusiness.net) has joined #ceph
[15:35] * KindOne_ (kindone@h248.177.190.173.ip.windstream.net) has joined #ceph
[15:38] * nhm (~nhm@c-50-171-139-246.hsd1.mn.comcast.net) has joined #ceph
[15:38] * ChanServ sets mode +o nhm
[15:40] * ron-slc (~Ron@173-165-129-118-utah.hfc.comcastbusiness.net) Quit (Quit: Ex-Chat)
[15:40] * ron-slc (~Ron@173-165-129-118-utah.hfc.comcastbusiness.net) has joined #ceph
[15:41] * srk (~Siva@cpe-70-113-23-93.austin.res.rr.com) Quit (Ping timeout: 480 seconds)
[15:41] * KindOne (kindone@0001a7db.user.oftc.net) Quit (Ping timeout: 480 seconds)
[15:41] * KindOne_ is now known as KindOne
[15:42] * Racpatel (~Racpatel@c-73-194-155-223.hsd1.nj.comcast.net) has joined #ceph
[15:43] * vikhyat (~vumrao@121.244.87.116) Quit (Quit: Leaving)
[15:45] * ivve (~zed@cust-gw-11.se.zetup.net) Quit (Ping timeout: 480 seconds)
[15:45] * mattbenjamin (~mbenjamin@12.118.3.106) has joined #ceph
[15:46] * derjohn_mob (~aj@46.189.28.53) Quit (Ping timeout: 480 seconds)
[15:50] * kefu (~kefu@114.92.125.128) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[15:50] * bara (~bara@213.175.37.12) Quit (Ping timeout: 480 seconds)
[15:51] * rraja (~rraja@125.16.34.66) Quit (Ping timeout: 480 seconds)
[15:52] * xarses_ (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[15:52] * derjohn_mob (~aj@46.189.28.64) has joined #ceph
[15:55] * srk (~Siva@cpe-70-113-23-93.austin.res.rr.com) has joined #ceph
[15:57] * pvh_sa (~pvh@41.164.8.114) has joined #ceph
[15:59] * valeech (~valeech@50.240.90.190) has joined #ceph
[15:59] * rraja (~rraja@121.244.87.117) has joined #ceph
[16:00] * F|1nt (~F|1nt@host37-211.lan-isdn.imaginet.fr) Quit (Quit: Be back later ...)
[16:00] <pvh_sa> hi there! we have a ceph deployment on CentOS 7.1 that is on Hammer (0.94). We would like to upgrade to Jewel, but the "Upgrading Ceph" documentation only goes as far as Firefly - is there a guide somewhere else on how to do the upgrade for the latest versions?
[16:01] * bara (~bara@nat-pool-brq-t.redhat.com) has joined #ceph
[16:02] * epicguy (~epicguy@41.164.8.42) Quit (Quit: Leaving)
[16:04] * sudocat (~dibarra@192.185.1.20) has joined #ceph
[16:07] * srk (~Siva@cpe-70-113-23-93.austin.res.rr.com) Quit (Ping timeout: 480 seconds)
[16:08] * baotiao (~baotiao@43.255.178.227) has joined #ceph
[16:08] <m0zes> pvh_sa: http://docs.ceph.com/docs/jewel/release-notes/
[16:08] * xarses_ (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) has joined #ceph
[16:09] * pvh_sa (~pvh@41.164.8.114) Quit (Ping timeout: 480 seconds)
[16:10] <moegyver> follow up on osds not coming up after boot: turns out /var/lib/ceph/tmp/ceph-disk.activate.lock and ceph-disk.prepare.lock had bogus permissions.
[16:11] <moegyver> the udev triggers run ceph-disk as ceph, the file was owned by root:root
[16:11] <moegyver> works great with ceph:root
[16:11] * i_m (~ivan.miro@109.188.125.146) has joined #ceph
[16:12] * sudocat (~dibarra@192.185.1.20) Quit (Ping timeout: 480 seconds)
[16:18] * swami1 (~swami@49.38.1.183) Quit (Quit: Leaving.)
[16:20] * sleinen1 (~Adium@2001:620:0:82::100) has joined #ceph
[16:23] * i_m (~ivan.miro@109.188.125.146) Quit (Ping timeout: 480 seconds)
[16:24] * xarses_ (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[16:25] * sudocat (~dibarra@192.185.1.20) has joined #ceph
[16:25] * Discovery (~Discovery@109.235.52.5) has joined #ceph
[16:26] * The1w (~jens@node3.survey-it.dk) Quit (Ping timeout: 480 seconds)
[16:27] * zigo (~quassel@gplhost-3-pt.tunnel.tserv18.fra1.ipv6.he.net) Quit (Read error: Connection reset by peer)
[16:28] * borei (~dan@node-1w7jr9qle4x5jh0iosd7q10ov.ipv6.telus.net) Quit (Ping timeout: 480 seconds)
[16:31] * zigo (~quassel@182.54.233.6) has joined #ceph
[16:31] * zigo is now known as Guest991
[16:32] * ron-slc (~Ron@173-165-129-118-utah.hfc.comcastbusiness.net) Quit (Read error: Connection reset by peer)
[16:33] * johnavp1989 (~jpetrini@8.39.115.8) has joined #ceph
[16:33] <- *johnavp1989* To prove that you are human, please enter the result of 8+3
[16:33] * Guest991 is now known as zigo_
[16:34] * baotiao_ (~baotiao@43.255.178.239) has joined #ceph
[16:35] * kristen (~kristen@134.134.139.76) has joined #ceph
[16:36] * xarses_ (~xarses@64.124.158.3) has joined #ceph
[16:37] * i_m (~ivan.miro@94.25.168.89) has joined #ceph
[16:37] * baotiao (~baotiao@43.255.178.227) Quit (Ping timeout: 480 seconds)
[16:37] * baotiao_ is now known as baotiao
[16:38] * srk (~Siva@32.97.110.52) has joined #ceph
[16:38] * joshd1 (~jdurgin@2602:30a:c089:2b0:df0:a2fd:ee5c:7344) has joined #ceph
[16:40] * ron-slc (~Ron@173-165-129-118-utah.hfc.comcastbusiness.net) has joined #ceph
[16:43] * kefu (~kefu@114.92.125.128) has joined #ceph
[16:43] * i_m (~ivan.miro@94.25.168.89) Quit (Read error: Connection reset by peer)
[16:46] * shaunm (~shaunm@cpe-192-180-17-174.kya.res.rr.com) has joined #ceph
[16:49] <jdillaman> sep: the nbd kernel driver has some bugs wrt to large block device support
[16:50] * vbellur (~vijay@71.234.224.255) Quit (Ping timeout: 480 seconds)
[16:50] <btaylor> does anyone know if the qemu qmp command blockdev-add supports rbd? seems like its still under development and may not?
[16:50] * valeech (~valeech@50.240.90.190) Quit (Ping timeout: 480 seconds)
[16:50] <jdillaman> sep: it only supports 512 byte sector sizes and 32bit number of sectors -- so that limits you to roughly 2TB
[16:52] <jdillaman> sep: the odd size you are seeing it just do to the high 32bits getting truncated within the kernel
[16:53] <chrishuen> Hi have a ceph-mon problem. My cluster stopped working after I had to restart the machines, which it is installed on. My setup includes 3 hosts, one of which is currently down, but the cluster remained healthy since the other two could build a quorum just fine. No I restarted the hosts, because of a planned power outtage and the monitor on my 2nd node won't come up again. As a result the OSD daemons won't start either (naturally). My ceph-mon log reads
[16:53] <chrishuen> "2016-09-06 11:15:30.237519 7f8aeb1eb880 -1 error opening mon data directory at '/var/lib/ceph/mon/ceph-lanai': (22) Invalid argument 2016-09-06 11:22:54.777162 7f9f7411e880 0 ceph version 9.2.0 (bb2ecea240f3a1d525bcb35670cb07bd1f0ca299), process ceph-mon, pid 11486" Additionally I get a 'ceph-mon[2011]: Corruption: checksum mismatch' message, when trying to start it manually. I am running CEPH 9.2.0 on CentOS 7a and installed it via the Quick Start Gu
[16:53] <chrishuen> Any help would be greatly appreciated!
[16:54] <btaylor> chrishuen: are the drives mounted?
[16:54] <Be-El> chrishuen: so 2 of 3 mons are not available?
[16:55] * ircolle (~Adium@2601:285:201:633a:19f:e2d7:59a2:44a1) has joined #ceph
[16:56] * ashah (~ashah@121.244.87.117) Quit (Quit: Leaving)
[16:59] <chrishuen> btaylor: yes! and accessible and permissions are all ceph:ceph
[16:59] <chrishuen> Be-El: yepp
[17:00] <chrishuen> one node crashed (faulty ibm drive) and the other one failed after restart due to planned power outtage
[17:00] * Esge (~Dysgalt@exit0.radia.tor-relays.net) has joined #ceph
[17:01] <Be-El> chrishuen: the second node's problem look like a hardware issue, e.g. faulty drives, raid controller writeback cache problems etc. this should be investigated after bringing the cluster back
[17:02] * vbellur (~vijay@nat-pool-bos-u.redhat.com) has joined #ceph
[17:04] * ivveh (~ivveh@c83-254-11-200.bredband.comhem.se) has joined #ceph
[17:04] * derjohn_mob (~aj@46.189.28.64) Quit (Ping timeout: 480 seconds)
[17:04] * rmart04_ (~rmart04@5.153.255.226) has joined #ceph
[17:06] * valeech (~valeech@wsip-98-175-102-67.dc.dc.cox.net) has joined #ceph
[17:07] * Skaag (~lunix@cpe-172-91-77-84.socal.res.rr.com) Quit (Quit: Leaving.)
[17:07] * wushudoin (~wushudoin@2601:646:8281:cfd:2ab2:bdff:fe0b:a6ee) has joined #ceph
[17:08] * wushudoin (~wushudoin@2601:646:8281:cfd:2ab2:bdff:fe0b:a6ee) Quit ()
[17:08] * wushudoin (~wushudoin@2601:646:8281:cfd:2ab2:bdff:fe0b:a6ee) has joined #ceph
[17:09] * owasserm_ (~owasserm@2001:984:d3f7:1:5ec5:d4ff:fee0:f6dc) has joined #ceph
[17:09] * owasserm_ (~owasserm@2001:984:d3f7:1:5ec5:d4ff:fee0:f6dc) Quit (Remote host closed the connection)
[17:10] * jowilkin (~jowilkin@2601:644:4000:b0bf:56ee:75ff:fe10:724e) has joined #ceph
[17:12] * sebastian-w (~quassel@212.218.8.138) has joined #ceph
[17:12] * Brochacho (~alberto@niu1mms-156-002.cso.niu.edu) has joined #ceph
[17:13] * derjohn_mob (~aj@46.189.28.65) has joined #ceph
[17:13] * valeech_ (~valeech@166.170.32.242) has joined #ceph
[17:13] * krypto (~krypto@G68-90-105-157.sbcis.sbc.com) Quit (Ping timeout: 480 seconds)
[17:15] * sebastian-w_ (~quassel@212.218.8.139) Quit (Ping timeout: 480 seconds)
[17:17] * xinli (~charleyst@32.97.110.55) has joined #ceph
[17:17] * ledgr_ (~ledgr@88-119-196-104.static.zebra.lt) Quit (Ping timeout: 480 seconds)
[17:18] * kefu (~kefu@114.92.125.128) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[17:18] * valeech (~valeech@wsip-98-175-102-67.dc.dc.cox.net) Quit (Ping timeout: 480 seconds)
[17:18] * valeech_ is now known as valeech
[17:19] * mykola (~Mikolaj@91.245.79.191) has joined #ceph
[17:20] * ledgr (~ledgr@84.15.179.174) has joined #ceph
[17:21] * squizzi (~squizzi@107.13.237.240) Quit (Ping timeout: 480 seconds)
[17:22] * valeech_ (~valeech@wsip-98-175-102-67.dc.dc.cox.net) has joined #ceph
[17:23] * pvh_sa (~pvh@169-0-184-226.ip.afrihost.co.za) has joined #ceph
[17:23] * ledgr_ (~ledgr@78.57.252.56) has joined #ceph
[17:23] * ledgr_ (~ledgr@78.57.252.56) Quit (Remote host closed the connection)
[17:23] * analbeard (~shw@support.memset.com) Quit (Ping timeout: 480 seconds)
[17:23] * ledgr_ (~ledgr@88-119-196-104.static.zebra.lt) has joined #ceph
[17:24] * Dw_Sn (~Dw_Sn@00020a72.user.oftc.net) Quit (Quit: Lost terminal)
[17:26] * valeech (~valeech@166.170.32.242) Quit (Ping timeout: 480 seconds)
[17:26] * EinstCrazy (~EinstCraz@58.39.76.12) Quit (Remote host closed the connection)
[17:28] * baotiao (~baotiao@43.255.178.239) Quit (Ping timeout: 480 seconds)
[17:28] * EinstCrazy (~EinstCraz@58.39.76.12) has joined #ceph
[17:29] * sudocat (~dibarra@192.185.1.20) Quit (Ping timeout: 480 seconds)
[17:29] * baotiao (~baotiao@43.255.178.227) has joined #ceph
[17:29] * baotiao (~baotiao@43.255.178.227) Quit ()
[17:30] * ledgr (~ledgr@84.15.179.174) Quit (Ping timeout: 480 seconds)
[17:30] * Esge (~Dysgalt@exit0.radia.tor-relays.net) Quit ()
[17:30] * valeech_ (~valeech@wsip-98-175-102-67.dc.dc.cox.net) Quit (Ping timeout: 480 seconds)
[17:31] * ircolle (~Adium@2601:285:201:633a:19f:e2d7:59a2:44a1) Quit (Quit: Leaving.)
[17:32] * moegyver (~moe@212.85.78.250) Quit (Ping timeout: 480 seconds)
[17:32] * squizzi (~squizzi@107.13.237.240) has joined #ceph
[17:33] * rmart04_ (~rmart04@5.153.255.226) Quit (Quit: rmart04_)
[17:34] * karnan (~karnan@121.244.87.117) Quit (Remote host closed the connection)
[17:34] * zhen (~Thunderbi@43.255.178.227) Quit (Remote host closed the connection)
[17:35] * zhen (~Thunderbi@43.255.178.227) has joined #ceph
[17:36] * rmart04 (~rmart04@support.memset.com) has joined #ceph
[17:36] * EinstCrazy (~EinstCraz@58.39.76.12) Quit (Ping timeout: 480 seconds)
[17:39] * Jeffrey4l_ (~Jeffrey@110.252.41.177) Quit (Ping timeout: 480 seconds)
[17:41] * sudocat (~dibarra@192.185.1.20) has joined #ceph
[17:42] * rmart04 (~rmart04@support.memset.com) Quit (Quit: rmart04)
[17:43] * Brochacho (~alberto@niu1mms-156-002.cso.niu.edu) Quit (Quit: Brochacho)
[17:45] * kefu (~kefu@114.92.125.128) has joined #ceph
[17:46] * F|1nt (~F|1nt@85-170-91-210.rev.numericable.fr) has joined #ceph
[17:48] * doppelgrau (~doppelgra@132.252.235.172) Quit (Quit: Leaving.)
[17:48] * xinli (~charleyst@32.97.110.55) Quit (Remote host closed the connection)
[17:48] * xinli (~charleyst@32.97.110.55) has joined #ceph
[17:51] * Brochacho (~alberto@niu1mms-156-002.cso.niu.edu) has joined #ceph
[17:57] * TMM (~hp@185.5.121.201) Quit (Quit: Ex-Chat)
[17:58] * bara (~bara@nat-pool-brq-t.redhat.com) Quit (Ping timeout: 480 seconds)
[17:59] * Be-El (~blinke@nat-router.computational.bio.uni-giessen.de) Quit (Quit: Leaving.)
[18:02] * chrishuen (~oftc-webi@141.22.31.103) Quit (Quit: Page closed)
[18:05] * linuxkidd (~linuxkidd@ip70-189-202-62.lv.lv.cox.net) has joined #ceph
[18:05] * derjohn_mob (~aj@46.189.28.65) Quit (Ping timeout: 480 seconds)
[18:07] * Skaag (~lunix@65.200.54.234) has joined #ceph
[18:09] * bara (~bara@213.175.37.12) has joined #ceph
[18:10] * ledgr_ (~ledgr@88-119-196-104.static.zebra.lt) Quit (Remote host closed the connection)
[18:12] * vbellur (~vijay@nat-pool-bos-u.redhat.com) Quit (Ping timeout: 480 seconds)
[18:12] * Brochacho (~alberto@niu1mms-156-002.cso.niu.edu) Quit (Quit: Brochacho)
[18:17] * branto (~branto@ip-78-102-208-181.net.upcbroadband.cz) Quit (Quit: Leaving.)
[18:17] * blizzow (~jburns@50-243-148-102-static.hfc.comcastbusiness.net) has joined #ceph
[18:22] * vasu (~vasu@c-73-231-60-138.hsd1.ca.comcast.net) has joined #ceph
[18:24] * vbellur (~vijay@nat-pool-bos-t.redhat.com) has joined #ceph
[18:29] * lifeboy (~roland@196.45.25.14) has joined #ceph
[18:29] * SamYaple (~SamYaple@162.209.126.134) Quit (Remote host closed the connection)
[18:30] * SamYaple (~SamYaple@162.209.126.134) has joined #ceph
[18:30] * zhen (~Thunderbi@43.255.178.227) Quit (Remote host closed the connection)
[18:33] * kefu is now known as kefu|afk
[18:34] * kefu|afk (~kefu@114.92.125.128) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[18:35] * sto (~sto@121.red-2-139-229.staticip.rima-tde.net) Quit (Ping timeout: 480 seconds)
[18:37] * sleinen1 (~Adium@2001:620:0:82::100) Quit (Ping timeout: 480 seconds)
[18:38] * sto (~sto@121.red-2-139-229.staticip.rima-tde.net) has joined #ceph
[18:38] * DanFoster (~Daniel@office.34sp.com) Quit (Quit: Leaving)
[18:39] * davidzlap (~Adium@2605:e000:1313:8003:9025:525b:2aea:f861) has joined #ceph
[18:43] * georgem1 (~Adium@206.108.127.16) has joined #ceph
[18:44] * neurodrone__ (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) has joined #ceph
[18:46] * pvh_sa (~pvh@169-0-184-226.ip.afrihost.co.za) Quit (Ping timeout: 480 seconds)
[18:46] * ira (~ira@nat-pool-bos-t.redhat.com) Quit (Quit: Leaving)
[18:47] * Coestar (~Pieman@exit-01a.noisetor.net) has joined #ceph
[18:47] * salwasser (~Adium@73.38.85.141) has joined #ceph
[18:48] * neurodrone_ (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) Quit (Ping timeout: 480 seconds)
[18:48] * treenerd_ (~gsulzberg@cpe90-146-148-47.liwest.at) has joined #ceph
[18:49] * georgem (~Adium@206.108.127.16) Quit (Ping timeout: 480 seconds)
[18:50] * haplo37 (~haplo37@199.91.185.156) has joined #ceph
[18:51] * doppelgrau (~doppelgra@dslb-088-072-094-200.088.072.pools.vodafone-ip.de) has joined #ceph
[18:56] * lxo (~aoliva@lxo.user.oftc.net) Quit (Ping timeout: 480 seconds)
[18:56] * salwasser (~Adium@73.38.85.141) Quit (Ping timeout: 480 seconds)
[19:02] * andreww (~xarses@64.124.158.3) has joined #ceph
[19:02] * xarses_ (~xarses@64.124.158.3) Quit (Read error: Connection reset by peer)
[19:07] * huangjun (~kvirc@117.152.95.235) Quit (Ping timeout: 480 seconds)
[19:07] * wes_dillingham (~wes_dilli@140.247.242.44) has joined #ceph
[19:09] * wjw-freebsd (~wjw@smtp.digiware.nl) has joined #ceph
[19:09] * _mrp (~mrp@82.117.199.26) Quit (Max SendQ exceeded)
[19:09] * F|1nt (~F|1nt@85-170-91-210.rev.numericable.fr) Quit (Quit: Oups, just gone away...)
[19:10] * vasu (~vasu@c-73-231-60-138.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[19:10] * _mrp (~mrp@82.117.199.26) has joined #ceph
[19:10] * vasu (~vasu@c-73-231-60-138.hsd1.ca.comcast.net) has joined #ceph
[19:13] * ircolle (~Adium@2601:285:201:633a:19f:e2d7:59a2:44a1) has joined #ceph
[19:15] * bara (~bara@213.175.37.12) Quit (Ping timeout: 480 seconds)
[19:17] * Coestar (~Pieman@exit-01a.noisetor.net) Quit ()
[19:19] * TMM (~hp@dhcp-077-248-009-229.chello.nl) has joined #ceph
[19:25] * pdrakewe_ (~pdrakeweb@oh-76-5-108-60.dhcp.embarqhsd.net) Quit (Quit: Leaving...)
[19:27] * rotbeard (~redbeard@185.32.80.238) Quit (Quit: Leaving)
[19:28] * pdrakeweb (~pdrakeweb@cpe-71-74-153-111.neo.res.rr.com) has joined #ceph
[19:29] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[19:30] * joshd1 (~jdurgin@2602:30a:c089:2b0:df0:a2fd:ee5c:7344) Quit (Quit: Leaving.)
[19:33] * ircolle (~Adium@2601:285:201:633a:19f:e2d7:59a2:44a1) Quit (Quit: Leaving.)
[19:35] * ircolle (~Adium@2601:285:201:633a:19f:e2d7:59a2:44a1) has joined #ceph
[19:35] * xinli (~charleyst@32.97.110.55) Quit (Ping timeout: 480 seconds)
[19:36] * haplo37 (~haplo37@199.91.185.156) Quit (Ping timeout: 480 seconds)
[19:44] * Hemanth (~hkumar_@103.228.221.177) has joined #ceph
[19:47] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:4d30:1cb6:3a49:7398) Quit (Ping timeout: 480 seconds)
[19:47] * Brochacho (~alberto@niu1mms-156-003.cso.niu.edu) has joined #ceph
[19:49] * Brochacho (~alberto@niu1mms-156-003.cso.niu.edu) Quit ()
[19:53] * KeeperOfTheSoul (~Deiz@91.ip-164-132-51.eu) has joined #ceph
[19:58] * stiopa (~stiopa@cpc73832-dals21-2-0-cust453.20-2.cable.virginm.net) has joined #ceph
[19:59] * oliveiradan (~doliveira@137.65.133.10) Quit (Remote host closed the connection)
[19:59] * oliveiradan2 (~doliveira@67.214.238.80) Quit (Quit: Leaving)
[20:06] * blynch (~blynch@vm-nat.msi.umn.edu) Quit (Remote host closed the connection)
[20:06] * doppelgrau_ (~doppelgra@dslb-088-072-094-200.088.072.pools.vodafone-ip.de) has joined #ceph
[20:10] * dgurtner (~dgurtner@84-73-130-19.dclient.hispeed.ch) Quit (Ping timeout: 480 seconds)
[20:11] * doppelgrau (~doppelgra@dslb-088-072-094-200.088.072.pools.vodafone-ip.de) Quit (Ping timeout: 480 seconds)
[20:11] * doppelgrau_ is now known as doppelgrau
[20:23] * KeeperOfTheSoul (~Deiz@91.ip-164-132-51.eu) Quit ()
[20:24] * johnavp1989 (~jpetrini@8.39.115.8) Quit (Ping timeout: 480 seconds)
[20:30] * LiamMon (~liam.monc@2.123.203.107) has joined #ceph
[20:33] * rendar (~I@host197-114-dynamic.57-82-r.retail.telecomitalia.it) Quit (Ping timeout: 480 seconds)
[20:34] * ntpttr_ (~ntpttr@jfdmzpr05-ext.jf.intel.com) has joined #ceph
[20:35] * shaunm (~shaunm@cpe-192-180-17-174.kya.res.rr.com) Quit (Ping timeout: 480 seconds)
[20:35] * LiamMon_ (~liam.monc@90.220.144.90) Quit (Ping timeout: 480 seconds)
[20:35] * Hemanth (~hkumar_@103.228.221.177) Quit (Quit: Leaving)
[20:37] * lxo (~aoliva@lxo.user.oftc.net) Quit (Remote host closed the connection)
[20:39] * ntpttr_ (~ntpttr@jfdmzpr05-ext.jf.intel.com) Quit ()
[20:39] * brians__ (~brian@80.111.114.175) Quit (Quit: Textual IRC Client: www.textualapp.com)
[20:39] * brians (~brian@80.111.114.175) has joined #ceph
[20:40] * ivveh (~ivveh@c83-254-11-200.bredband.comhem.se) Quit (Ping timeout: 480 seconds)
[20:44] * wes_dillingham (~wes_dilli@140.247.242.44) Quit (Ping timeout: 480 seconds)
[20:49] * salwasser (~Adium@73.114.26.205) has joined #ceph
[20:50] * wes_dillingham (~wes_dilli@65.112.8.193) has joined #ceph
[20:51] * jowilkin (~jowilkin@2601:644:4000:b0bf:56ee:75ff:fe10:724e) Quit (Ping timeout: 480 seconds)
[20:52] * _mrp (~mrp@82.117.199.26) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[20:54] * salwasser1 (~Adium@73.38.85.141) has joined #ceph
[20:54] * pvh_sa (~pvh@169-0-184-226.ip.afrihost.co.za) has joined #ceph
[20:57] * salwasser (~Adium@73.114.26.205) Quit (Ping timeout: 480 seconds)
[20:58] * rendar (~I@host197-114-dynamic.57-82-r.retail.telecomitalia.it) has joined #ceph
[20:59] * Eman1 (~AGaW@host245-190-static.207-80-b.business.telecomitalia.it) has joined #ceph
[21:02] * salwasser1 (~Adium@73.38.85.141) Quit (Ping timeout: 480 seconds)
[21:02] * sudocat (~dibarra@192.185.1.20) Quit (Quit: Leaving.)
[21:02] * sudocat (~dibarra@192.185.1.20) has joined #ceph
[21:09] * xinli (~charleyst@32.97.110.56) has joined #ceph
[21:09] * valeech (~valeech@pool-96-247-203-33.clppva.fios.verizon.net) has joined #ceph
[21:11] * smiley__ (~quassel@205.153.36.170) Quit (Remote host closed the connection)
[21:11] * Pulp (~Pulp@195.50.221.63) has joined #ceph
[21:21] * wes_dillingham (~wes_dilli@65.112.8.193) Quit (Quit: wes_dillingham)
[21:21] * wushudoin (~wushudoin@2601:646:8281:cfd:2ab2:bdff:fe0b:a6ee) Quit (Ping timeout: 480 seconds)
[21:21] * hexbinder (~wschroed@157.130.171.46) has joined #ceph
[21:23] * wushudoin (~wushudoin@2601:646:8200:c9f0:2ab2:bdff:fe0b:a6ee) has joined #ceph
[21:24] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[21:24] * rmart04 (~rmart04@host86-177-156-212.range86-177.btcentralplus.com) has joined #ceph
[21:24] * TomasCZ (~TomasCZ@yes.tenlab.net) has joined #ceph
[21:24] <hexbinder> Hello! I'm working on adding a check-and-cleanup for leaked multipart objects, and while I can do a list operation and get back the keys I want, I am having a whale of a time deleting. Can anyone spare a moment of time with me to look over my attempts and shoot me some ideas or pointers?
[21:25] <hexbinder> My delete problem is that when delete_objs attempts to get state of my object, which I had just successfully found, the object is not seen as existing or having a size.
[21:25] <hexbinder> So I am thinking there must be something wrong with how I am forming the object for the delete.
[21:27] * sudocat (~dibarra@192.185.1.20) Quit (Ping timeout: 480 seconds)
[21:27] * sudocat (~dibarra@192.185.1.20) has joined #ceph
[21:27] * sleinen1 (~Adium@2001:620:0:82::100) has joined #ceph
[21:29] * Eman1 (~AGaW@host245-190-static.207-80-b.business.telecomitalia.it) Quit ()
[21:29] * wes_dillingham (~wes_dilli@140.247.242.44) has joined #ceph
[21:31] * CephFan1 (~textual@68-233-224-176.static.hvvc.us) has joined #ceph
[21:35] * rmart04 (~rmart04@host86-177-156-212.range86-177.btcentralplus.com) Quit (Quit: rmart04)
[21:35] * bjozet_ (~bjozet@82.183.17.144) Quit (Remote host closed the connection)
[21:41] * scg (~zscg@181.122.4.166) has left #ceph
[21:42] * scg (~zscg@181.122.4.166) has joined #ceph
[21:42] * sudocat1 (~dibarra@192.185.1.20) has joined #ceph
[21:42] * sudocat (~dibarra@192.185.1.20) Quit (Read error: Connection reset by peer)
[21:44] * jowilkin (~jowilkin@2601:644:4000:b0bf:56ee:75ff:fe10:724e) has joined #ceph
[21:49] * xinli (~charleyst@32.97.110.56) Quit (Ping timeout: 480 seconds)
[21:49] * cr0wrx (~cr0wrx@c-50-180-203-98.hsd1.ga.comcast.net) has joined #ceph
[21:50] <cr0wrx> quick question from a ceph n00b doing some performance tests on cluster trying to diagnose issue - is performance on rbd bench-write supposed to be less than rados bench? My understanding is rbd relies on rados, so I would think so, but it's the other way around for me
[21:54] * lifeboy (~roland@196.45.25.14) Quit (Read error: Connection reset by peer)
[21:57] * _mrp (~mrp@93-86-57-229.dynamic.isp.telekom.rs) has joined #ceph
[21:57] * elfurbe (~Adam@saint.uits.arizona.edu) has joined #ceph
[21:57] <The1_> your understading is correct - a RBD image is made up of a number of radob objects - you can actually use rados commands to see individual pieces of the RBD
[21:58] <The1_> perhaps cache is in play when writing to the RBD in your tests
[21:59] <cr0wrx> perhaps...I cleared cache as recommended before each test in http://tracker.ceph.com/projects/ceph/wiki/Benchmark_Ceph_Cluster_Performance
[21:59] <The1_> you should make sure that every write is sync'ed to the RBD and that the OS doesn't cache anything
[22:00] <cr0wrx> I avg 144MB/s with rados bench, and ~479MB/s with rbd bench-write
[22:00] <The1_> that's pretty darn much
[22:00] <cr0wrx> so it seemed pretty different and also reversed as well
[22:02] <cr0wrx> Maybe I'm doing something wrong, idk. I've heard complaints that "storage is slow"
[22:03] <cr0wrx> I've also kinda experienced a bit myself on a different cluster I run at home where it seemed slower than expected, but that's a completely diff. thing (I was getting ~40MB/s there in benchmarks, but it took all night for me to transfer 500GB between block devices)
[22:03] <cr0wrx> but it should've taken several hours at least I guess on that one
[22:05] <cr0wrx> in any case, is it expected to have raw writes (with dd) roughly 2.5-3.0x what we get with rados? Or is that a matter of not enough physical disks and/or replication?
[22:05] <The1_> no
[22:05] <The1_> rados write and rbd writes should be similar
[22:06] <georgem1> cr0wrx: are you using the same pool for both tests?
[22:06] <cr0wrx> my rados read was a lot lower for the numbers above
[22:06] <cr0wrx> yes
[22:06] <The1_> at least if you remove all forms of cache, async writing and fsync
[22:06] <cr0wrx> My reads were 107 MB/s for seq and 137MB/s for rand
[22:08] <cr0wrx> this is an odd cluster setup though, I won't lie (with RAID on these disks). But, on both this one and my home one (without RAID), my dd raw write speed on disks was 2.5-3x that of what I get with rados bench
[22:09] <blizzow> What's the right way to re-balance data across OSDs? Some of my OSDs are 7% full and others are 15% full.
[22:09] <blizzow> I want to avoid manually adjusting the CRUSH map.
[22:11] <elfurbe> So, are there any scary gotchas going from infernalis to jewel for a cluster using exclusively rbd? I've found some mention of the krbd driver being incompatible with the new default RBD parameters currently, are there any other flashing red lights I'm missing?
[22:12] * mykola (~Mikolaj@91.245.79.191) Quit (Quit: away)
[22:21] * vbellur (~vijay@nat-pool-bos-t.redhat.com) Quit (Ping timeout: 480 seconds)
[22:28] * oliveiradan2 (~doliveira@67.214.238.80) has joined #ceph
[22:28] * georgem1 (~Adium@206.108.127.16) Quit (Ping timeout: 480 seconds)
[22:31] * haplo37 (~haplo37@199.91.185.156) has joined #ceph
[22:32] * srk (~Siva@32.97.110.52) Quit (Ping timeout: 480 seconds)
[22:36] * georgem (~Adium@24.114.71.73) has joined #ceph
[22:37] * georgem (~Adium@24.114.71.73) Quit ()
[22:37] * lxo (~aoliva@lxo.user.oftc.net) Quit (Ping timeout: 480 seconds)
[22:37] * georgem (~Adium@24.114.71.73) has joined #ceph
[22:38] * srk (~Siva@32.97.110.52) has joined #ceph
[22:39] * wkennington (~wkenningt@c-71-204-170-241.hsd1.ca.comcast.net) has joined #ceph
[22:39] * georgem (~Adium@24.114.71.73) Quit ()
[22:43] * liiwi_ is now known as liiwi
[22:43] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[22:43] * Skaag (~lunix@65.200.54.234) Quit (Quit: Leaving.)
[22:48] * msudnick (~michael@24-212-218-207.cable.teksavvy.com) has joined #ceph
[22:50] * pvh_sa (~pvh@169-0-184-226.ip.afrihost.co.za) Quit (Ping timeout: 480 seconds)
[22:51] * johnavp1989 (~jpetrini@8.39.115.8) has joined #ceph
[22:51] <- *johnavp1989* To prove that you are human, please enter the result of 8+3
[22:52] * cr0wrx (~cr0wrx@c-50-180-203-98.hsd1.ga.comcast.net) Quit (Quit: Leaving...)
[22:54] * mattbenjamin (~mbenjamin@12.118.3.106) Quit (Quit: Leaving.)
[22:54] * salwasser (~Adium@73.38.85.141) has joined #ceph
[22:59] <msudnick> I was wondering if someone could help me recover a PG, a few days ago I had a bunch of disks die in a small home-lab cluster. I removed the disks from their hosts, and rm'ed the OSDs. Now I have a PG stuck down, that will not peer whose acting OSDs (and the primary) are one of the OSDs I had rm'ed earlier. I believe generally one would mark the OSD lost to try to get the PG to recovery, however as I rm'ed the OSD earlier I cannot mark it
[22:59] * hexbinder (~wschroed@157.130.171.46) Quit (Quit: leaving)
[23:01] * treenerd_ (~gsulzberg@cpe90-146-148-47.liwest.at) Quit (Quit: treenerd_)
[23:01] * lifeboy (~roland@196.45.25.14) has joined #ceph
[23:03] * salwasser (~Adium@73.38.85.141) Quit (Ping timeout: 480 seconds)
[23:05] * ledgr (~ledgr@78.57.252.56) has joined #ceph
[23:06] * wes_dillingham (~wes_dilli@140.247.242.44) Quit (Ping timeout: 480 seconds)
[23:08] * coreping (~Michael_G@n1.coreping.org) Quit (Quit: WeeChat 0.4.2)
[23:08] * rdias (~rdias@bl7-92-98.dsl.telepac.pt) Quit (Ping timeout: 480 seconds)
[23:09] * georgem (~Adium@24.114.69.38) has joined #ceph
[23:10] * DaveOD_ (~DaveOD@nomadesk.com) Quit (Ping timeout: 480 seconds)
[23:13] * rdias (~rdias@2001:8a0:749a:d01:7d47:77c7:9af1:4502) has joined #ceph
[23:14] * bniver (~bniver@71-9-144-29.static.oxfr.ma.charter.com) Quit (Remote host closed the connection)
[23:16] * georgem (~Adium@24.114.69.38) has left #ceph
[23:17] * andreww (~xarses@64.124.158.3) Quit (Ping timeout: 480 seconds)
[23:23] * brad_mssw (~brad@66.129.88.50) Quit (Quit: Leaving)
[23:24] * murmur (~murmur@zeeb.org) Quit (Read error: Connection reset by peer)
[23:24] * coreping (~Michael_G@n1.coreping.org) has joined #ceph
[23:25] * ledgr (~ledgr@78.57.252.56) Quit (Remote host closed the connection)
[23:26] * murmur (~murmur@zeeb.org) has joined #ceph
[23:26] * rmart04 (~rmart04@host86-177-156-212.range86-177.btcentralplus.com) has joined #ceph
[23:26] * sleinen1 (~Adium@2001:620:0:82::100) Quit (Ping timeout: 480 seconds)
[23:27] * coreping (~Michael_G@n1.coreping.org) Quit ()
[23:27] * lxo (~aoliva@lxo.user.oftc.net) Quit (Remote host closed the connection)
[23:34] * rmart04 (~rmart04@host86-177-156-212.range86-177.btcentralplus.com) has left #ceph
[23:35] * msudnick (~michael@24-212-218-207.cable.teksavvy.com) Quit (Quit: Leaving.)
[23:37] * johnavp1989 (~jpetrini@8.39.115.8) Quit (Ping timeout: 480 seconds)
[23:47] * haplo37 (~haplo37@199.91.185.156) Quit (Ping timeout: 480 seconds)
[23:51] * N3X15 (~lobstar@108.61.122.72) has joined #ceph
[23:54] * CephFan1 (~textual@68-233-224-176.static.hvvc.us) Quit (Quit: Textual IRC Client: www.textualapp.com)
[23:56] * srk (~Siva@32.97.110.52) Quit (Ping timeout: 480 seconds)
[23:57] * Racpatel (~Racpatel@c-73-194-155-223.hsd1.nj.comcast.net) Quit (Ping timeout: 480 seconds)
[23:58] * wjw-freebsd2 (~wjw@smtp.digiware.nl) has joined #ceph

These logs were automatically created by CephLogBot on irc.oftc.net using the Java IRC LogBot.