#ceph IRC Log

Index

IRC Log for 2012-05-31

Timestamps are in GMT/BST.

[0:04] * s[X] (~sX]@ppp59-167-154-113.static.internode.on.net) has joined #ceph
[0:05] * s[X]_ (~sX]@ppp59-167-154-113.static.internode.on.net) has joined #ceph
[0:05] * s[X] (~sX]@ppp59-167-154-113.static.internode.on.net) Quit (Read error: Connection reset by peer)
[1:06] * krisek_ (~kris@dsdf-4d0a0675.pool.mediaWays.net) has joined #ceph
[1:09] * sbohrer (~sbohrer@173.227.92.65) Quit (Quit: Leaving)
[1:22] * krisek (~krisek@www.nowhere-else.org) Quit (Remote host closed the connection)
[1:23] * krisek (~krisek@www.nowhere-else.org) has joined #ceph
[1:29] * adjohn (~adjohn@69.170.166.146) has joined #ceph
[1:32] * krisek_ (~kris@dsdf-4d0a0675.pool.mediaWays.net) has left #ceph
[1:33] * krisek_ (~kris@dsdf-4d0a0675.pool.mediaWays.net) has joined #ceph
[1:36] <krisek_> hi, just for the record (thanks for the help yehudasa) the 'rgw dns name' config parameter was missing from my ceph.conf and this mixed up clients using virtual naming scheme
[1:36] * krisek_ (~kris@dsdf-4d0a0675.pool.mediaWays.net) has left #ceph
[1:43] * andreask (~andreas@chello062178013131.5.11.vie.surfer.at) Quit (Ping timeout: 480 seconds)
[1:44] * lofejndif (~lsqavnbok@9KCAAFSRR.tor-irc.dnsbl.oftc.net) Quit (Ping timeout: 480 seconds)
[1:47] * BManojlovic (~steki@212.200.243.232) Quit (Remote host closed the connection)
[1:55] * lofejndif (~lsqavnbok@1RDAAB90K.tor-irc.dnsbl.oftc.net) has joined #ceph
[2:08] * Tv_ (~tv@aon.hq.newdream.net) Quit (Ping timeout: 480 seconds)
[2:13] * lofejndif (~lsqavnbok@1RDAAB90K.tor-irc.dnsbl.oftc.net) Quit (Quit: gone)
[2:28] * vhasi (vhasi@vha.si) Quit (Quit: bbl)
[2:47] * aliguori (~anthony@202.108.130.138) has joined #ceph
[2:52] * jantje (jan@paranoid.nl) Quit (Ping timeout: 480 seconds)
[2:56] * joshd (~joshd@aon.hq.newdream.net) Quit (Quit: Leaving.)
[2:56] * aa (~aa@r200-40-114-26.ae-static.anteldata.net.uy) Quit (Read error: Connection reset by peer)
[3:01] * jantje (jan@paranoid.nl) has joined #ceph
[3:09] * aliguori (~anthony@202.108.130.138) Quit (Ping timeout: 480 seconds)
[3:37] * adjohn is now known as Guest2044
[3:37] * adjohn (~adjohn@69.170.166.146) has joined #ceph
[3:43] * Guest2044 (~adjohn@69.170.166.146) Quit (Ping timeout: 480 seconds)
[3:48] * adjohn (~adjohn@69.170.166.146) Quit (Quit: adjohn)
[3:49] * adjohn (~adjohn@69.170.166.146) has joined #ceph
[3:50] * adjohn (~adjohn@69.170.166.146) Quit ()
[3:51] * joao (~JL@aon.hq.newdream.net) Quit (Remote host closed the connection)
[3:53] * yoshi (~yoshi@p3167-ipngn3601marunouchi.tokyo.ocn.ne.jp) has joined #ceph
[4:07] * krisek (~krisek@www.nowhere-else.org) Quit (Remote host closed the connection)
[4:08] * krisek (~krisek@www.nowhere-else.org) has joined #ceph
[4:08] * vhasi (martin@vha.si) has joined #ceph
[4:27] * MarkDude (~MT@c-71-198-138-155.hsd1.ca.comcast.net) Quit (Read error: Connection reset by peer)
[4:34] * MarkDude (~MT@c-71-198-138-155.hsd1.ca.comcast.net) has joined #ceph
[4:59] * LarsFronius (~LarsFroni@95-91-243-252-dynip.superkabel.de) has joined #ceph
[5:15] * chutzpah (~chutz@216.174.109.254) Quit (Quit: Leaving)
[5:26] * renzhi (~renzhi@180.169.73.90) has joined #ceph
[5:32] * LarsFronius (~LarsFroni@95-91-243-252-dynip.superkabel.de) Quit (Quit: LarsFronius)
[5:38] * aa (~aa@r190-135-21-225.dialup.adsl.anteldata.net.uy) has joined #ceph
[5:50] * renzhi (~renzhi@180.169.73.90) Quit (Ping timeout: 480 seconds)
[6:05] * renzhi (~renzhi@180.169.73.90) has joined #ceph
[6:06] * aa (~aa@r190-135-21-225.dialup.adsl.anteldata.net.uy) Quit (Ping timeout: 480 seconds)
[6:44] * cattelan is now known as cattelan_away
[6:46] * aliguori (~anthony@202.108.130.138) has joined #ceph
[6:56] * krisek (~krisek@www.nowhere-else.org) Quit (Remote host closed the connection)
[6:58] * krisek (~krisek@www.nowhere-else.org) has joined #ceph
[7:07] * dmick (~dmick@aon.hq.newdream.net) Quit (Quit: Leaving.)
[7:09] * aliguori_ (~anthony@202.108.130.138) has joined #ceph
[7:13] * aliguori (~anthony@202.108.130.138) Quit (Ping timeout: 480 seconds)
[7:18] * MarkDude (~MT@c-71-198-138-155.hsd1.ca.comcast.net) Quit (Quit: Leaving)
[7:35] * MarkDude (~MT@c-71-198-138-155.hsd1.ca.comcast.net) has joined #ceph
[8:08] * aliguori_ (~anthony@202.108.130.138) Quit (Ping timeout: 480 seconds)
[8:17] * The_Bishop (~bishop@cable-86-56-102-91.cust.telecolumbus.net) Quit (Quit: Wer zum Teufel ist dieser Peer? Wenn ich den erwische dann werde ich ihm mal die Verbindung resetten!)
[8:47] * verwilst (~verwilst@d5152FEFB.static.telenet.be) has joined #ceph
[8:54] * lxo (~aoliva@lxo.user.oftc.net) Quit (Ping timeout: 480 seconds)
[9:02] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[9:05] * gregaf (~Adium@aon.hq.newdream.net) has joined #ceph
[9:10] * gregaf1 (~Adium@aon.hq.newdream.net) Quit (Ping timeout: 480 seconds)
[9:17] * mkampe (~markk@aon.hq.newdream.net) Quit (Ping timeout: 480 seconds)
[9:17] * sjust (~sam@aon.hq.newdream.net) Quit (Ping timeout: 480 seconds)
[9:17] * gregaf (~Adium@aon.hq.newdream.net) Quit (Ping timeout: 480 seconds)
[9:18] * sjust (~sam@aon.hq.newdream.net) has joined #ceph
[9:18] * gregaf (~Adium@aon.hq.newdream.net) has joined #ceph
[9:18] * yehudasa (~yehudasa@aon.hq.newdream.net) Quit (Ping timeout: 480 seconds)
[9:18] * sagewk (~sage@aon.hq.newdream.net) Quit (Ping timeout: 480 seconds)
[9:19] * yehudasa (~yehudasa@aon.hq.newdream.net) has joined #ceph
[9:20] * sagewk (~sage@aon.hq.newdream.net) has joined #ceph
[9:21] * mkampe (~markk@aon.hq.newdream.net) has joined #ceph
[9:25] * andreask (~andreas@chello062178013131.5.11.vie.surfer.at) has joined #ceph
[9:26] * BManojlovic (~steki@91.195.39.5) has joined #ceph
[9:32] * gregaf (~Adium@aon.hq.newdream.net) Quit (Ping timeout: 480 seconds)
[9:32] * mkampe (~markk@aon.hq.newdream.net) Quit (Ping timeout: 480 seconds)
[9:34] * gregaf (~Adium@aon.hq.newdream.net) has joined #ceph
[9:35] * mkampe (~markk@aon.hq.newdream.net) has joined #ceph
[9:44] * gregaf1 (~Adium@aon.hq.newdream.net) has joined #ceph
[9:46] * gregaf1 (~Adium@aon.hq.newdream.net) Quit (Read error: Connection reset by peer)
[9:47] * gregaf1 (~Adium@aon.hq.newdream.net) has joined #ceph
[9:50] * Ryan_Lane (~Adium@business-088-079-092-162.static.arcor-ip.net) Quit (Ping timeout: 480 seconds)
[9:50] * gregaf (~Adium@aon.hq.newdream.net) Quit (Ping timeout: 480 seconds)
[10:04] * mkampe (~markk@aon.hq.newdream.net) Quit (Ping timeout: 480 seconds)
[10:04] * gregaf1 (~Adium@aon.hq.newdream.net) Quit (Ping timeout: 480 seconds)
[10:04] * sjust (~sam@aon.hq.newdream.net) Quit (Ping timeout: 480 seconds)
[10:04] * yehudasa (~yehudasa@aon.hq.newdream.net) Quit (Ping timeout: 480 seconds)
[10:04] * sagewk (~sage@aon.hq.newdream.net) Quit (Ping timeout: 480 seconds)
[10:11] * krisek (~krisek@www.nowhere-else.org) Quit (Remote host closed the connection)
[10:11] * krisek (~krisek@www.nowhere-else.org) has joined #ceph
[10:12] * renzhi (~renzhi@180.169.73.90) Quit (Quit: Leaving)
[10:14] * MarkDude (~MT@c-71-198-138-155.hsd1.ca.comcast.net) Quit (Quit: Leaving)
[10:29] * yehudasa (~yehudasa@aon.hq.newdream.net) has joined #ceph
[10:29] * sjust (~sam@aon.hq.newdream.net) has joined #ceph
[10:30] * gregaf (~Adium@aon.hq.newdream.net) has joined #ceph
[10:37] * sjust (~sam@aon.hq.newdream.net) Quit (Ping timeout: 480 seconds)
[10:38] * s[X]_ (~sX]@ppp59-167-154-113.static.internode.on.net) Quit (Remote host closed the connection)
[10:38] * gregaf (~Adium@aon.hq.newdream.net) Quit (Ping timeout: 480 seconds)
[10:39] * yehudasa (~yehudasa@aon.hq.newdream.net) Quit (Ping timeout: 480 seconds)
[10:44] * yehudasa (~yehudasa@aon.hq.newdream.net) has joined #ceph
[10:45] * sjust (~sam@aon.hq.newdream.net) has joined #ceph
[10:45] * mkampe (~markk@aon.hq.newdream.net) has joined #ceph
[10:46] * sagewk (~sage@aon.hq.newdream.net) has joined #ceph
[10:47] * gregaf (~Adium@aon.hq.newdream.net) has joined #ceph
[10:58] * wido_ (~wido@rockbox.widodh.nl) has joined #ceph
[11:06] * Ryan_Lane (~Adium@p54834911.dip.t-dialin.net) has joined #ceph
[11:10] * krisek (~krisek@www.nowhere-else.org) has left #ceph
[11:47] * mtk (~mtk@ool-44c35967.dyn.optonline.net) Quit (Remote host closed the connection)
[11:48] * s[X]_ (~sX]@ppp59-167-157-96.static.internode.on.net) has joined #ceph
[11:50] * hijacker_ (~hijacker@213.91.163.5) Quit (Quit: Leaving)
[11:50] * mtk (~mtk@ool-44c35967.dyn.optonline.net) has joined #ceph
[11:54] * hijacker (~hijacker@213.91.163.5) has joined #ceph
[11:59] * lofejndif (~lsqavnbok@9KCAAFS8I.tor-irc.dnsbl.oftc.net) has joined #ceph
[12:18] * yoshi (~yoshi@p3167-ipngn3601marunouchi.tokyo.ocn.ne.jp) Quit (Remote host closed the connection)
[12:34] * nhorman (~nhorman@99-127-245-201.lightspeed.rlghnc.sbcglobal.net) has joined #ceph
[12:52] * verwilst (~verwilst@d5152FEFB.static.telenet.be) Quit (Ping timeout: 480 seconds)
[12:58] * LarsFronius (~LarsFroni@95-91-243-252-dynip.superkabel.de) has joined #ceph
[13:20] * Qten (~qgrasso@ip-121-0-1-110.static.dsl.onqcomms.net) Quit (Read error: No route to host)
[13:25] * Qten (~qgrasso@ip-121-0-1-110.static.dsl.onqcomms.net) has joined #ceph
[13:46] * LarsFronius (~LarsFroni@95-91-243-252-dynip.superkabel.de) Quit (Quit: LarsFronius)
[14:02] * LarsFronius (~LarsFroni@95-91-243-252-dynip.superkabel.de) has joined #ceph
[14:31] * hijacker (~hijacker@213.91.163.5) Quit (Quit: Leaving)
[14:34] * hijacker (~hijacker@213.91.163.5) has joined #ceph
[14:37] * LarsFronius (~LarsFroni@95-91-243-252-dynip.superkabel.de) Quit (Quit: LarsFronius)
[14:38] * hijacker (~hijacker@213.91.163.5) Quit (Remote host closed the connection)
[14:44] * hijacker (~hijacker@213.91.163.5) has joined #ceph
[14:44] * Qten (~qgrasso@ip-121-0-1-110.static.dsl.onqcomms.net) Quit (Read error: Connection reset by peer)
[14:44] * Qten (~qgrasso@ip-121-0-1-110.static.dsl.onqcomms.net) has joined #ceph
[15:35] * LarsFronius (~LarsFroni@95-91-243-252-dynip.superkabel.de) has joined #ceph
[16:20] * lofejndif (~lsqavnbok@9KCAAFS8I.tor-irc.dnsbl.oftc.net) Quit (Quit: gone)
[16:54] * stass (stas@ssh.deglitch.com) Quit (Read error: Connection reset by peer)
[16:55] * stass (stas@ssh.deglitch.com) has joined #ceph
[16:59] * hijacker (~hijacker@213.91.163.5) Quit (reticulum.oftc.net charon.oftc.net)
[16:59] * Ryan_Lane (~Adium@p54834911.dip.t-dialin.net) Quit (reticulum.oftc.net charon.oftc.net)
[16:59] * ceph-test (~Runner@mail.lexinter-sa.COM) Quit (reticulum.oftc.net charon.oftc.net)
[16:59] * jefferai (~quassel@quassel.jefferai.org) Quit (reticulum.oftc.net charon.oftc.net)
[16:59] * raso (~raso@deb-multimedia.org) Quit (reticulum.oftc.net charon.oftc.net)
[16:59] * Mareo (~mareo@mareo.fr) Quit (reticulum.oftc.net charon.oftc.net)
[16:59] * LarsFronius (~LarsFroni@95-91-243-252-dynip.superkabel.de) Quit (reticulum.oftc.net charon.oftc.net)
[16:59] * wido_ (~wido@rockbox.widodh.nl) Quit (reticulum.oftc.net charon.oftc.net)
[16:59] * BManojlovic (~steki@91.195.39.5) Quit (reticulum.oftc.net charon.oftc.net)
[16:59] * vhasi (martin@vha.si) Quit (reticulum.oftc.net charon.oftc.net)
[16:59] * morse (~morse@supercomputing.univpm.it) Quit (reticulum.oftc.net charon.oftc.net)
[16:59] * johnl (~johnl@2a02:1348:14c:1720:90c2:4d90:e349:1a9c) Quit (reticulum.oftc.net charon.oftc.net)
[16:59] * goedi (goedi@195.26.5.166) Quit (reticulum.oftc.net charon.oftc.net)
[16:59] * alexxy (~alexxy@79.173.81.171) Quit (reticulum.oftc.net charon.oftc.net)
[16:59] * ogelbukh (~weechat@nat3.4c.ru) Quit (reticulum.oftc.net charon.oftc.net)
[16:59] * Anticimex (anticimex@netforce.csbnet.se) Quit (reticulum.oftc.net charon.oftc.net)
[16:59] * Meyer__ (meyer@c64.org) Quit (reticulum.oftc.net charon.oftc.net)
[16:59] * Ludo_ (~Ludo@falbala.zoxx.net) Quit (reticulum.oftc.net charon.oftc.net)
[16:59] * dwm_ (~dwm@2001:ba8:0:1c0:225:90ff:fe08:9150) Quit (reticulum.oftc.net charon.oftc.net)
[16:59] * todin (tuxadero@kudu.in-berlin.de) Quit (reticulum.oftc.net charon.oftc.net)
[16:59] * RupS (~rups@panoramix.m0z.net) Quit (reticulum.oftc.net charon.oftc.net)
[16:59] * Dieter_b1 (~Dieterbe@dieter2.plaetinck.be) Quit (reticulum.oftc.net charon.oftc.net)
[16:59] * stass (stas@ssh.deglitch.com) Quit (Read error: Connection reset by peer)
[17:02] * stass (stas@ssh.deglitch.com) has joined #ceph
[17:02] * hijacker (~hijacker@213.91.163.5) has joined #ceph
[17:02] * Ryan_Lane (~Adium@p54834911.dip.t-dialin.net) has joined #ceph
[17:02] * ceph-test (~Runner@mail.lexinter-sa.COM) has joined #ceph
[17:02] * jefferai (~quassel@quassel.jefferai.org) has joined #ceph
[17:02] * raso (~raso@deb-multimedia.org) has joined #ceph
[17:02] * Mareo (~mareo@mareo.fr) has joined #ceph
[17:02] * LarsFronius (~LarsFroni@95-91-243-252-dynip.superkabel.de) has joined #ceph
[17:02] * wido_ (~wido@rockbox.widodh.nl) has joined #ceph
[17:02] * BManojlovic (~steki@91.195.39.5) has joined #ceph
[17:02] * vhasi (martin@vha.si) has joined #ceph
[17:02] * morse (~morse@supercomputing.univpm.it) has joined #ceph
[17:02] * johnl (~johnl@2a02:1348:14c:1720:90c2:4d90:e349:1a9c) has joined #ceph
[17:02] * goedi (goedi@195.26.5.166) has joined #ceph
[17:02] * alexxy (~alexxy@79.173.81.171) has joined #ceph
[17:02] * ogelbukh (~weechat@nat3.4c.ru) has joined #ceph
[17:02] * Anticimex (anticimex@netforce.csbnet.se) has joined #ceph
[17:02] * todin (tuxadero@kudu.in-berlin.de) has joined #ceph
[17:02] * dwm_ (~dwm@2001:ba8:0:1c0:225:90ff:fe08:9150) has joined #ceph
[17:02] * Dieter_b1 (~Dieterbe@dieter2.plaetinck.be) has joined #ceph
[17:02] * Ludo_ (~Ludo@falbala.zoxx.net) has joined #ceph
[17:02] * RupS (~rups@panoramix.m0z.net) has joined #ceph
[17:02] * Meyer__ (meyer@c64.org) has joined #ceph
[17:02] * jeffhung_ (~jeffhung@60-250-103-120.HINET-IP.hinet.net) has joined #ceph
[17:04] * jeffhung (~jeffhung@60-250-103-120.HINET-IP.hinet.net) Quit (Ping timeout: 480 seconds)
[17:11] * BManojlovic (~steki@91.195.39.5) Quit (Quit: Ja odoh a vi sta 'ocete...)
[17:11] * gohko_ (~gohko@natter.interq.or.jp) has joined #ceph
[17:12] * Qu310 (~qgrasso@ppp59-167-157-24.static.internode.on.net) Quit (Remote host closed the connection)
[17:13] * Qu310 (~qgrasso@ppp59-167-157-24.static.internode.on.net) has joined #ceph
[17:16] * gohko (~gohko@natter.interq.or.jp) Quit (Ping timeout: 480 seconds)
[17:36] * Tv_ (~tv@aon.hq.newdream.net) has joined #ceph
[17:44] <guido> Hi, does anybody know why ceph-fuse fail with (95) Operation not supported
[17:44] <guido> ?
[17:48] <Tv_> guido: at startup or during some filesystem operation?
[17:48] <guido> At startup
[17:49] <Tv_> guido: sorry, phone call, will be back
[17:49] <guido> the command was "ceph-fuse /cephpool/ -n client.vshost1". The fs is not mounted afterwards
[17:49] <Tv_> guido: check the log
[17:52] <guido> The following appears in /var/log/ceph/client.vshost1.log after I run that command: http://pastebin.com/LK4bi6im
[17:53] <guido> BTW, I can mount the fs using the in-kernel client and I can mount it via fuse from another client. I'm really stumped as to why it won't work here
[17:53] <Tv_> guido: auth setting mismatch?
[17:53] <Tv_> it says auth_reply...
[17:55] * Azrael (~azrael@terra.negativeblue.com) has joined #ceph
[17:55] <guido> Tv_: Hey, that was it!
[17:55] <Tv_> heh
[17:56] <guido> The ceph.conf on the client had "auth supported = cephx" commented out
[17:56] <guido> Thanks for the help
[17:56] * The_Bishop (~bishop@cable-86-56-102-91.cust.telecolumbus.net) has joined #ceph
[17:58] * sbohrer (~sbohrer@173.227.92.65) has joined #ceph
[17:59] * Ryan_Lane (~Adium@p54834911.dip.t-dialin.net) Quit (Quit: Leaving.)
[18:01] * ninkotech (~duplo@static-84-242-87-186.net.upcbroadband.cz) Quit (Read error: Connection reset by peer)
[18:01] * ninkotech (~duplo@static-84-242-87-186.net.upcbroadband.cz) has joined #ceph
[18:02] * joshd (~joshd@aon.hq.newdream.net) has joined #ceph
[18:03] * BManojlovic (~steki@212.200.243.232) has joined #ceph
[18:05] * LarsFronius (~LarsFroni@95-91-243-252-dynip.superkabel.de) Quit (Quit: LarsFronius)
[18:10] * MarkDude (~MT@c-71-198-138-155.hsd1.ca.comcast.net) has joined #ceph
[18:24] <sbohrer> It looks like I've encountered a ceph bug. I've got at least two empty directories that report "rmdir: /c/users/sbohrer/fio/o5007: Directory not empty" despite being empty
[18:25] <sbohrer> I've also got a number of these "[ERR] loaded dup inode 1000001aa48 [2,head] v44262 at /users/sbohrer/fio/o5007/writer.1.106, but inode 1000001aa48.head v1630929 already exists at ~mds0/stray8/1000001aa48"
[18:25] <sbohrer> followed by a number of these "[WRN] replayed op client.4104:70041,70040 used ino 10000035751 but session next is 1000000000d"
[18:27] * nhorman (~nhorman@99-127-245-201.lightspeed.rlghnc.sbcglobal.net) Quit (Ping timeout: 480 seconds)
[18:29] <sbohrer> Yikes, and my /var/log/ceph/ceph-mds.a.log is enormous
[18:34] <sbohrer> 1 mds.0.cache.dir(1000000a75d) mismatch between child accounted_rstats and my rstats!
[18:34] <sbohrer> tons of messages like:
[18:34] * nhorman (~nhorman@99-127-245-201.lightspeed.rlghnc.sbcglobal.net) has joined #ceph
[18:35] <sbohrer> 1 mds.0.cache.dir(1000000a75d) [dentry #1/users/sbohrer/fio/o5007/writer.1.1 [2,head] auth (dversion lock) pv=0 v=51201 inode=0x10045e80 | inodepin 0x935e578] n(v0 b262144 1=1+0)
[18:36] <Tv_> guido: filed http://tracker.newdream.net/issues/2492 .. at some point we need to go through all the user interfaces and improve all of them
[18:37] <Tv_> ideally at the same time as we improve test coverage for those failures ;)
[18:44] <guido> Tv_: Good thinking
[18:46] * adjohn (~adjohn@69.170.166.146) has joined #ceph
[18:51] * andreask (~andreas@chello062178013131.5.11.vie.surfer.at) Quit (Quit: Leaving.)
[19:03] <elder> yehudasa, you marked patches 1,2,4,5,6 reviewed, but not 3. Can I mark it reviewed?
[19:04] <yehudasa> elder: not yet
[19:04] <elder> OK.
[19:04] <elder> Just checking.
[19:04] <yehudasa> I skipped it on purpose
[19:04] <yehudasa> was not a trivial syntax change
[19:10] * aa (~aa@r200-40-114-26.ae-static.anteldata.net.uy) has joined #ceph
[19:21] * chutzpah (~chutz@216.174.109.254) has joined #ceph
[19:28] * Ryan_Lane (~Adium@gateway01.m3-connect.de) has joined #ceph
[19:29] * Oliver1 (~oliver1@ip-78-94-238-50.unitymediagroup.de) has joined #ceph
[19:31] <sbohrer> Does anyone have any thoughts on my issue? Should I just file a bug with the info I have?
[19:32] <sbohrer> Also is there anyway to recover at this point or do I need to mkcephfs?
[19:34] * Ryan_Lane (~Adium@gateway01.m3-connect.de) Quit (Quit: Leaving.)
[19:48] * dmick (~dmick@aon.hq.newdream.net) has joined #ceph
[19:52] <The_Bishop> sbohrer: which filesystem does the faulty OSD work on?
[19:52] <The_Bishop> did fsck pass?
[19:53] <sbohrer> The_Bishop: All the OSDs are on xfs
[19:53] <The_Bishop> had similar issues, but with btrfs
[19:54] * bchrisman (~Adium@c-76-103-130-94.hsd1.ca.comcast.net) Quit (Quit: Leaving.)
[19:54] <The_Bishop> found out later that the "directory not empty" was caused by the use of snapshots
[19:55] <sbohrer> I haven't created any snapshots. Just created/deleted a bunch of files.
[19:56] <sbohrer> I'm assuming you also mean running fsck on the underlying xfs filesystem. I haven't tried that yet.
[19:59] <The_Bishop> yes, i suspect a FS problem under ceph
[20:00] <The_Bishop> you will have to stop the corresponding OSD and umount the partition
[20:00] <The_Bishop> if not it's cephs fault
[20:05] * cattelan_away is now known as cattelan
[20:06] * CristianDM (~CristianD@host217.190-230-240.telecom.net.ar) has joined #ceph
[20:12] * lofejndif (~lsqavnbok@82VAAD7AD.tor-irc.dnsbl.oftc.net) has joined #ceph
[20:36] <sbohrer> The_Bishop: All of the error messages in the logs are from the mds I don't see any indication of which OSD might have the problem
[20:36] <sbohrer> I can probably fsck them all
[20:37] * adjohn (~adjohn@69.170.166.146) Quit (Quit: adjohn)
[20:37] <sbohrer> But shouldn't ceph replication handle a problem with the underlying filesystem?
[20:38] <The_Bishop> oh, MDSes does not use local storage, the put everything on OSDs
[20:38] <sbohrer> understood, but which one?
[20:38] <The_Bishop> but the error may originate from some OSD where the data should be
[20:42] <The_Bishop> from the log messages you presented i see /c/users/sbohrer/fio/ ...
[20:42] <The_Bishop> have you checked this FS?
[20:43] <The_Bishop> seems your MDS puts stuff there
[20:43] <sbohrer> Yes /c is my ceph mount
[20:43] <The_Bishop> ah, ok
[20:44] <The_Bishop> then, the MDS metadata inside ceph seems to be faulty
[20:45] <The_Bishop> what does "ceph health" look like?
[20:45] * bchrisman (~Adium@108.60.121.114) has joined #ceph
[20:45] <sbohrer> currently says HEALTH_OK
[20:46] <The_Bishop> hmm, at this point my experience with this is exhausted :(
[20:47] <sbohrer> I'm going to file a but with the info I have so far, then format and increase the debugging levels and see if I can reproduce the issue.
[20:47] <sbohrer> Er, file a bug
[20:49] <The_Bishop> well, you could turn on full debugging and go until the error happens again
[20:49] <The_Bishop> better move the old log away before starting MDS with full debug
[20:50] <The_Bishop> the old log could have a trace when the error was introduced, and the debug log shows for which keys to look
[21:06] <jmlowe> I've had situations where the underlying disks were throwing read errors but somewhere between the driver and vfs the disk wouldn't get knocked offline so the osd's had no idea there was a problem
[21:36] <elder> I'm back.
[21:37] <nhm> elder: how was the water skiiing?
[21:40] <elder> A bit windy. But it's different going out midday instead of early in the morning.
[21:40] <elder> It was fun. I wish I could do that more often.
[21:43] <dmick> is the problem that the water is too often in the wrong phase?
[21:45] <elder> It's the amplitude that kills you.
[21:45] <jmlowe> would be a bit difficult if were a gas
[21:45] <elder> Oh you mean as in phase change.
[21:45] <elder> I was thinking of phase of a wave.
[21:45] <jmlowe> I did he didn't
[21:46] <elder> No, as long as it's got a big enough area of liquid surface, I'm there.
[21:46] <dmick> it's pretty difficult to waterski on ice as well
[21:46] <elder> Not on ice, but among it is doable.
[21:53] * dmick trembles in fear
[22:39] * joao (~JL@aon.hq.newdream.net) has joined #ceph
[22:41] * nhorman (~nhorman@99-127-245-201.lightspeed.rlghnc.sbcglobal.net) Quit (Quit: Leaving)
[22:46] * andreask (~andreas@chello062178013131.5.11.vie.surfer.at) has joined #ceph
[22:50] * andreask (~andreas@chello062178013131.5.11.vie.surfer.at) has left #ceph
[23:06] * s[X]_ (~sX]@ppp59-167-157-96.static.internode.on.net) Quit (Remote host closed the connection)
[23:09] * izdubar (~MT@c-71-198-138-155.hsd1.ca.comcast.net) has joined #ceph
[23:14] * MarkDude (~MT@c-71-198-138-155.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[23:17] * izdubar (~MT@c-71-198-138-155.hsd1.ca.comcast.net) Quit (Quit: Leaving)
[23:37] * aa (~aa@r200-40-114-26.ae-static.anteldata.net.uy) Quit (Quit: Konversation terminated!)
[23:37] * aa (~aa@r200-40-114-26.ae-static.anteldata.net.uy) has joined #ceph
[23:38] <dmick> nhm: yt?
[23:38] * MarkDude (~MT@c-71-198-138-155.hsd1.ca.comcast.net) has joined #ceph
[23:51] * CristianDM (~CristianD@host217.190-230-240.telecom.net.ar) Quit ()
[23:55] * s[X]_ (~sX]@ppp59-167-154-113.static.internode.on.net) has joined #ceph

These logs were automatically created by CephLogBot on irc.oftc.net using the Java IRC LogBot.