#ceph IRC Log

Index

IRC Log for 2016-04-08

Timestamps are in GMT/BST.

[0:00] <bdeetz> So far all of my tests have been successful and I haven't had any crashing or issues that didn't end up being my fault.
[0:00] <bdeetz> m0zes: have you experienced anything terrible with CephFS?
[0:01] * Racpatel (~Racpatel@2601:87:3:3601::2bdf) Quit (Ping timeout: 480 seconds)
[0:01] <ingard> bdeetz: what kind of drives do you use?
[0:01] * ibravo (~ibravo@72.83.69.64) Quit (Quit: Leaving)
[0:02] * brad_mssw (~brad@66.129.88.50) Quit (Quit: Leaving)
[0:02] * mlovell (~mlovell@69-195-66-94.unifiedlayer.com) Quit (Ping timeout: 480 seconds)
[0:03] <m0zes> do some load testing on it with multiple clients. we had some pain at first because we didn't tune the mds cache size to fit our active set. if you're running standby mds servers, make sure your cluster is fast, otherwise you may see the mds bouncing between servers.
[0:04] <m0zes> when running standby mds turn on hot-standby. the standby ones will then replay the mds-journal on the fly keeping up with changes, making failovers faster.
[0:04] * debian112 (~bcolbert@24.126.201.64) Quit (Read error: Connection reset by peer)
[0:05] <m0zes> and, as with all filesystems, don't put a million files in a single directory. nothing likes that.
[0:05] <bdeetz> ingard: I was planning on a combination of HGST, Seagate, and WD just to split up failures
[0:05] * ben3 (ben@pearl.meh.net.nz) Quit (Read error: Connection reset by peer)
[0:06] <bdeetz> m0zes: good to know about MDS. I do intend on having standby until active-active/load distribution is working and production ready.
[0:06] * BrianA (~Brian@c-50-168-46-112.hsd1.ca.comcast.net) has left #ceph
[0:06] * BrianA (~Brian@c-50-168-46-112.hsd1.ca.comcast.net) has joined #ceph
[0:07] * BrianA (~Brian@c-50-168-46-112.hsd1.ca.comcast.net) has left #ceph
[0:07] <bdeetz> m0zes: I experienced that with a user on a Panasas fs I used to maintain.
[0:08] * m0zes has a user with 200 million files in a single directory. I think they were using it as a cheap key-value store. under my old system an ls would hang your terminal for about 4 hours. then it would start printing. under ceph, the ls isn't bat, I've just seen performance problems updating metadata on the files.
[0:10] <m0zes> I've seen a client fail to release capabilites on a cephfs file/directory/whatever, and that can hang other clients access to that directory. I've still not pinned that down.
[0:10] <bdeetz> m0zes: I think you asked how many HBAs for the disks. I was planning on using 1 LSI 2308 IT mode. Bad idea?
[0:12] <m0zes> perhaps. congestion for traffic to 24-36 osds could be problematic
[0:15] * fsimonce (~simon@host201-70-dynamic.26-79-r.retail.telecomitalia.it) Quit (Quit: Coyote finally caught me)
[0:16] * Scrin (~datagutt@95.211.205.151) has joined #ceph
[0:17] * ben3 (ben@pearl.meh.net.nz) has joined #ceph
[0:18] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) has joined #ceph
[0:20] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) Quit (Read error: Connection reset by peer)
[0:20] * barra204 (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) has joined #ceph
[0:20] * dgurtner (~dgurtner@217.149.140.193) Quit (Ping timeout: 480 seconds)
[0:21] <bdeetz> Thanks to everybody for the feedback. I'm off for the day, but I'll be lurking for the foreseeable future.
[0:21] * Rickus_ (~Rickus@office.protected.ca) has joined #ceph
[0:21] * debian112 (~bcolbert@24.126.201.64) has joined #ceph
[0:22] * bdeetz (~bdeetz@72.194.132.130) has left #ceph
[0:22] * bdeetz (~bdeetz@72.194.132.130) has joined #ceph
[0:22] * bdeetz (~bdeetz@72.194.132.130) has left #ceph
[0:24] * Rickus (~Rickus@office.protected.ca) Quit (Ping timeout: 480 seconds)
[0:24] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:60fc:c21d:c1c6:96e4) Quit (Ping timeout: 480 seconds)
[0:27] * allaok (~allaok@ARennes-658-1-126-166.w83-199.abo.wanadoo.fr) Quit (Quit: Leaving.)
[0:27] * wushudoin (~wushudoin@38.140.108.2) Quit (Ping timeout: 480 seconds)
[0:28] * barra204 (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[0:31] * wushudoin (~wushudoin@38.140.108.2) has joined #ceph
[0:32] * angdraug (~angdraug@64.124.158.100) Quit (Quit: Leaving)
[0:32] * rmart04 (~rmart04@support.memset.com) Quit (Quit: rmart04)
[0:34] <darkfader> m0zes: i think you're absolutely right, the msi-x stuff probably scales with the number of hbas
[0:35] <darkfader> i recently read the guy that did the iops testing on freebsd also used 4 or 8 lsi in his box to get >1m iops
[0:35] <darkfader> i was very puzzled why i didn't get to >200k with a lot of proper ssds till i read that bit 2 years later
[0:39] * debian112 (~bcolbert@24.126.201.64) Quit (Read error: Connection reset by peer)
[0:42] * wushudoin (~wushudoin@38.140.108.2) Quit (Quit: Leaving)
[0:42] * wushudoin (~wushudoin@38.140.108.2) has joined #ceph
[0:46] * Scrin (~datagutt@06SAAA2Q4.tor-irc.dnsbl.oftc.net) Quit ()
[0:46] * Spikey (~TehZomB@67.ip-92-222-38.eu) has joined #ceph
[0:54] * wwdillingham (~LobsterRo@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) has joined #ceph
[0:57] * wwdillingham (~LobsterRo@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) Quit ()
[0:58] * debian112 (~bcolbert@24.126.201.64) has joined #ceph
[0:58] <TMM> m0zes, after another incident I think you were right, the slow request stop as soon as there are no more OSDs in 'activating' mode
[0:59] <TMM> it appears that peering/activating is what is causing my issues
[0:59] <TMM> I have 0 ideas on how to troubleshoot this though :P
[0:59] * olid19811115 (~olid1982@aftr-185-17-206-247.dynamic.mnet-online.de) Quit (Ping timeout: 480 seconds)
[1:16] <skullone> has anyone tried putting billions of objects in a ceph rgw?
[1:16] * Spikey (~TehZomB@6AGAAAKSG.tor-irc.dnsbl.oftc.net) Quit ()
[1:16] * visored (~phyphor@104.168.172.50) has joined #ceph
[1:17] * debian112 (~bcolbert@24.126.201.64) Quit (Read error: Connection reset by peer)
[1:20] * barra204 (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) has joined #ceph
[1:29] * barra204 (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[1:32] * sudocat (~dibarra@192.185.1.20) Quit (Ping timeout: 480 seconds)
[1:35] * Lea (~LeaChim@host86-159-239-193.range86-159.btcentralplus.com) Quit (Ping timeout: 480 seconds)
[1:43] * squizzi (~squizzi@107.13.31.195) has joined #ceph
[1:46] * visored (~phyphor@06SAAA2S5.tor-irc.dnsbl.oftc.net) Quit ()
[1:46] * visored (~Diablodoc@5.255.80.27) has joined #ceph
[1:48] * xarses (~xarses@64.124.158.100) Quit (Ping timeout: 480 seconds)
[1:52] * squizzi (~squizzi@107.13.31.195) Quit (Quit: to the moon!)
[1:52] * oms101 (~oms101@p20030057EA03A700C6D987FFFE4339A1.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[1:54] * wwdillingham (~LobsterRo@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) has joined #ceph
[1:55] * Skaag (~lunix@65.200.54.234) Quit (Quit: Leaving.)
[2:00] <_28_ria> Hello, I've updated all of the ceph cluster hosts from version 0.94.5 to 0.94.6 rebooted all hosts, osds on 2 other hosts all got brought up, but on the first host is down.
[2:01] * sudocat (~dibarra@2602:306:8bc7:4c50:248f:45e4:f8e4:e00c) has joined #ceph
[2:01] * oms101 (~oms101@p20030057EA03F700C6D987FFFE4339A1.dip0.t-ipconnect.de) has joined #ceph
[2:03] <_28_ria> When I try to do start ceph-osd id=0; etc..., it shows: ceph-osd (ceph/0) start/running, process 17826, etc. and osd tree shows that they are still down.
[2:05] <_28_ria> When I try to stop/start ceph-osd id=<idnum>. When stopping, it says: stop: Unknown instance: ceph/<idnum>
[2:06] <_28_ria> I've tried to launch with: ceph-osd -i <idnum> -f; It shows: ** ERROR: unable to open OSD superblock on /var/lib/ceph/osd/ceph-0: (2) No such file or directory
[2:06] <_28_ria> on all osds
[2:08] <_28_ria> I looked @ those paths: /var/lib/ceph/osd/ceph-<idnum>; They exist, but empty. I've found on the inet, that it supposed to be filled with files. I looked at the according folders on other hosts, that are up and saw, that they've had files in those folders.
[2:10] <_28_ria> Also, on the inet, somebody've mentioned, that those are OSD mount points. df -lh; on the first host (who's OSDs are down), shows that disks, managed by OSD, are not mounted.
[2:11] * xarses (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) has joined #ceph
[2:11] * wwdillingham (~LobsterRo@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) Quit (Quit: wwdillingham)
[2:12] * wwdillingham (~LobsterRo@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) has joined #ceph
[2:12] <_28_ria> I looked @ hosts with working OSDs, df -lh; showed that OSD managed disks are mounted there to those folders: /var/lib/ceph/osd/ceph-<idnum>
[2:14] * mattbenjamin1 (~mbenjamin@aa2.linuxbox.com) Quit (Quit: Leaving.)
[2:15] <_28_ria> command: ceph-deploy disk list host001; shows: /dev/sdb1 ceph data, prepared, unknown cluster 2720f4bb-b090-44be-9013-2ba8bc6ffd7a, osd.0; and for other OSDs - the same.
[2:16] <_28_ria> Checked out disk list on hostw, were OSDs are up: /dev/sdb1 ceph data, active, cluster ceph, osd.12
[2:16] * visored (~Diablodoc@4MJAAD2MV.tor-irc.dnsbl.oftc.net) Quit ()
[2:16] * Miho (~Azru@4MJAAD2NX.tor-irc.dnsbl.oftc.net) has joined #ceph
[2:17] <_28_ria> So, the host with down OSDs shows prepared, unknown cluster and the dist is not mounting, but on the working osd, it shows active and is mounted.
[2:17] <_28_ria> How do I fix this problem?
[2:18] * barra204 (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) has joined #ceph
[2:25] * wwdillingham (~LobsterRo@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) Quit (Quit: wwdillingham)
[2:26] * barra204 (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[2:28] * wwdillingham (~LobsterRo@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) has joined #ceph
[2:43] * efirs (~firs@c-50-185-70-125.hsd1.ca.comcast.net) has joined #ceph
[2:46] * Miho (~Azru@4MJAAD2NX.tor-irc.dnsbl.oftc.net) Quit ()
[2:46] * smf68 (~jwandborg@tor-exit6-readme.dfri.se) has joined #ceph
[2:49] * vicente (~vicente@1-163-217-223.dynamic.hinet.net) has joined #ceph
[2:53] * wwdillingham (~LobsterRo@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) Quit (Quit: wwdillingham)
[2:54] * bjornar__ (~bjornar@ti0099a430-1561.bb.online.no) Quit (Ping timeout: 480 seconds)
[3:00] * DV_ (~veillard@2001:41d0:a:f29f::1) has joined #ceph
[3:04] * wwdillingham (~LobsterRo@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) has joined #ceph
[3:13] * aj__ (~aj@x590cda2b.dyn.telefonica.de) has joined #ceph
[3:13] * wwdillingham (~LobsterRo@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) Quit (Quit: wwdillingham)
[3:14] * wwdillingham (~LobsterRo@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) has joined #ceph
[3:15] * derjohn_mobi (~aj@x4db1216c.dyn.telefonica.de) Quit (Read error: Connection reset by peer)
[3:16] * smf68 (~jwandborg@4MJAAD2OT.tor-irc.dnsbl.oftc.net) Quit ()
[3:16] * Harryhy (~delcake@hessel3.torservers.net) has joined #ceph
[3:17] * vicente (~vicente@1-163-217-223.dynamic.hinet.net) Quit (Ping timeout: 480 seconds)
[3:18] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) has joined #ceph
[3:19] * wwdillingham (~LobsterRo@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) Quit ()
[3:21] * EinstCrazy (~EinstCraz@58.247.119.250) has joined #ceph
[3:22] * chengmao (~chengmao@113.57.168.154) has joined #ceph
[3:26] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[3:35] * yanzheng (~zhyan@118.116.113.6) has joined #ceph
[3:39] * huangjun (~kvirc@113.57.168.154) has joined #ceph
[3:41] * joshd1 (~jdurgin@68-119-140-18.dhcp.ahvl.nc.charter.com) Quit (Quit: Leaving.)
[3:46] * Harryhy (~delcake@4MJAAD2PS.tor-irc.dnsbl.oftc.net) Quit ()
[3:46] * kalmisto (~anadrom@tollana.enn.lu) has joined #ceph
[3:47] * zhaochao (~zhaochao@125.39.9.156) has joined #ceph
[3:53] * Mika_c (~quassel@122.146.93.152) has joined #ceph
[4:02] * vasu (~vasu@c-73-231-60-138.hsd1.ca.comcast.net) Quit (Quit: Leaving)
[4:04] * ira (~ira@c-24-34-255-34.hsd1.ma.comcast.net) Quit (Quit: Leaving)
[4:05] * mondkalbantrieb (~quassel@sama32.de) Quit (Remote host closed the connection)
[4:16] * kalmisto (~anadrom@6AGAAAK0C.tor-irc.dnsbl.oftc.net) Quit ()
[4:16] * Xerati (~nih@tor.yrk.urgs.uk0.bigv.io) has joined #ceph
[4:18] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) has joined #ceph
[4:26] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[4:34] * georgem (~Adium@45.72.132.68) has joined #ceph
[4:46] * Xerati (~nih@6AGAAAK12.tor-irc.dnsbl.oftc.net) Quit ()
[4:46] * MonkeyJamboree (~ylmson@alpha.jpunix.net) has joined #ceph
[4:53] * EinstCrazy (~EinstCraz@58.247.119.250) Quit (Remote host closed the connection)
[4:54] * georgem (~Adium@45.72.132.68) Quit (Quit: Leaving.)
[4:54] * georgem (~Adium@206.108.127.16) has joined #ceph
[4:55] * EinstCrazy (~EinstCraz@58.247.119.250) has joined #ceph
[4:57] * EinstCrazy (~EinstCraz@58.247.119.250) Quit (Remote host closed the connection)
[4:58] * mlovell (~mlovell@45.56.59.158) has joined #ceph
[4:58] * mlovell (~mlovell@45.56.59.158) has left #ceph
[4:59] * EinstCrazy (~EinstCraz@58.247.119.250) has joined #ceph
[5:13] * kefu (~kefu@183.193.127.235) has joined #ceph
[5:16] * MonkeyJamboree (~ylmson@6AGAAAK3L.tor-irc.dnsbl.oftc.net) Quit ()
[5:16] * jakekosberg (~qable@193.90.12.88) has joined #ceph
[5:18] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) has joined #ceph
[5:20] * kefu_ (~kefu@114.92.120.83) has joined #ceph
[5:25] * Vacuum_ (~Vacuum@88.130.214.231) has joined #ceph
[5:25] * kefu_ (~kefu@114.92.120.83) Quit (Max SendQ exceeded)
[5:26] * kefu_ (~kefu@li1072-18.members.linode.com) has joined #ceph
[5:26] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[5:28] * kefu (~kefu@183.193.127.235) Quit (Ping timeout: 480 seconds)
[5:31] * georgem (~Adium@206.108.127.16) Quit (Quit: Leaving.)
[5:31] * vata (~vata@cable-21.246.173-197.electronicbox.net) Quit (Ping timeout: 480 seconds)
[5:32] * Vacuum__ (~Vacuum@i59F79C79.versanet.de) Quit (Ping timeout: 480 seconds)
[5:32] * joshd1 (~jdurgin@68-119-140-18.dhcp.ahvl.nc.charter.com) has joined #ceph
[5:41] * kefu (~kefu@114.92.120.83) has joined #ceph
[5:42] * _28_ria (~kvirc@opfr028.ru) Quit (Read error: Connection reset by peer)
[5:45] * kefu_ (~kefu@li1072-18.members.linode.com) Quit (Ping timeout: 480 seconds)
[5:46] * jakekosberg (~qable@6AGAAAK4R.tor-irc.dnsbl.oftc.net) Quit ()
[5:46] * Kyso (~aleksag@politkovskaja.torservers.net) has joined #ceph
[5:59] * vikhyat (~vumrao@121.244.87.116) has joined #ceph
[6:05] * joshd1 (~jdurgin@68-119-140-18.dhcp.ahvl.nc.charter.com) Quit (Quit: Leaving.)
[6:10] * wjw-freebsd (~wjw@smtp.digiware.nl) Quit (Ping timeout: 480 seconds)
[6:16] * Kyso (~aleksag@4MJAAD2UU.tor-irc.dnsbl.oftc.net) Quit ()
[6:16] * dug (~roaet@marcuse-1.nos-oignons.net) has joined #ceph
[6:18] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) has joined #ceph
[6:22] * janos_ (~messy@static-71-176-211-4.rcmdva.fios.verizon.net) has joined #ceph
[6:26] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[6:27] * janos (~messy@static-71-176-211-4.rcmdva.fios.verizon.net) Quit (Ping timeout: 480 seconds)
[6:40] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) has joined #ceph
[6:46] * dug (~roaet@06SAAA23C.tor-irc.dnsbl.oftc.net) Quit ()
[6:46] * Cue (~maku@tor01.zencurity.dk) has joined #ceph
[6:48] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[6:54] * redf_ (~red@chello080108089163.30.11.vie.surfer.at) Quit (Ping timeout: 480 seconds)
[6:54] * redf_ (~red@chello080108089163.30.11.vie.surfer.at) has joined #ceph
[6:58] * TomasCZ (~TomasCZ@yes.tenlab.net) Quit (Quit: Leaving)
[7:01] * huangjun|2 (~kvirc@113.57.168.154) has joined #ceph
[7:01] * m0zes (~mozes@ns1.beocat.ksu.edu) Quit (Ping timeout: 480 seconds)
[7:01] * huangjun|3 (~kvirc@113.57.168.154) has joined #ceph
[7:07] * m0zes (~mozes@129.130.32.11) has joined #ceph
[7:07] * huangjun (~kvirc@113.57.168.154) Quit (Ping timeout: 480 seconds)
[7:09] * huangjun|2 (~kvirc@113.57.168.154) Quit (Ping timeout: 480 seconds)
[7:16] * Cue (~maku@4MJAAD2V8.tor-irc.dnsbl.oftc.net) Quit ()
[7:18] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) has joined #ceph
[7:20] * reed (~reed@75-101-54-18.dsl.static.fusionbroadband.com) Quit (Quit: Ex-Chat)
[7:26] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[7:36] * krypto (~krypto@G68-90-105-14.sbcis.sbc.com) has joined #ceph
[7:37] * Skaag (~lunix@cpe-172-91-77-84.socal.res.rr.com) has joined #ceph
[7:42] * bjornar__ (~bjornar@ti0099a430-1561.bb.online.no) has joined #ceph
[7:47] * linjan_ (~linjan@176.195.217.66) Quit (Ping timeout: 480 seconds)
[7:51] * DougalJacobs (~Grimhound@109.201.133.100) has joined #ceph
[7:51] * Be-El (~blinke@nat-router.computational.bio.uni-giessen.de) has joined #ceph
[7:55] * _28_ria (~kvirc@opfr028.ru) has joined #ceph
[7:55] <_28_ria> OK, I've figured out about unknown cluster, that id: 2720f4bb-b090-44be-9013-2ba8bc6ffd7a changed in /etc/ceph/ceph.conf, so I've changed it back to 2720f4bb-b090-44be-9013-2ba8bc6ffd7a
[7:58] <_28_ria> now it gives me an other problem: if I activate the OSD disk: ceph-disk-activate /dev/sdb1, it gives me: Failed to get D-Bus connection: Operation not permitted; ceph-disk: Error: ceph osd start failed: Command '['/bin/systemctl', 'start', 'ceph-osd@0']' returned non-zero exit status 1
[7:58] * kefu (~kefu@114.92.120.83) Quit (Max SendQ exceeded)
[7:59] * kefu (~kefu@114.92.120.83) has joined #ceph
[8:13] * ade (~abradshaw@212.77.58.61) has joined #ceph
[8:13] * aj__ (~aj@x590cda2b.dyn.telefonica.de) Quit (Ping timeout: 480 seconds)
[8:15] * huangjun|3 (~kvirc@113.57.168.154) Quit (Ping timeout: 480 seconds)
[8:18] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) has joined #ceph
[8:20] * DougalJacobs (~Grimhound@06SAAA25Z.tor-irc.dnsbl.oftc.net) Quit ()
[8:21] * drupal (~matx@213.227.165.50) has joined #ceph
[8:24] * T1w (~jens@node3.survey-it.dk) has joined #ceph
[8:26] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[8:32] * vicente (~~vicente@125-227-238-55.HINET-IP.hinet.net) has joined #ceph
[8:32] * branto (~branto@178-253-132-82.3pp.slovanet.sk) has joined #ceph
[8:41] * bjornar__ (~bjornar@ti0099a430-1561.bb.online.no) Quit (Ping timeout: 480 seconds)
[8:46] * atheism (~atheism@182.48.117.114) has joined #ceph
[8:47] * RameshN (~rnachimu@121.244.87.117) has joined #ceph
[8:50] * drupal (~matx@6AGAAALBF.tor-irc.dnsbl.oftc.net) Quit ()
[8:51] * Shesh (~Mraedis@0.tor.exit.babylon.network) has joined #ceph
[8:56] * krypto (~krypto@G68-90-105-14.sbcis.sbc.com) Quit (Read error: Connection reset by peer)
[8:56] * allaok (~allaok@machine107.orange-labs.com) has joined #ceph
[8:57] * krypto (~krypto@sessfw99-sesbfw99-85.ericsson.net) has joined #ceph
[9:03] * Miouge_ (~Miouge@h-72-233.a163.priv.bahnhof.se) has joined #ceph
[9:06] * azizulhakim (~oftc-webi@neptune.cs.fiu.edu) Quit (Ping timeout: 480 seconds)
[9:10] * wjw-freebsd (~wjw@smtp.digiware.nl) has joined #ceph
[9:11] * MrAbaddon (~MrAbaddon@a89-155-99-93.cpe.netcabo.pt) Quit (Ping timeout: 480 seconds)
[9:13] * linjan_ (~linjan@86.62.112.22) has joined #ceph
[9:16] * analbeard (~shw@support.memset.com) has joined #ceph
[9:18] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) has joined #ceph
[9:19] * dupondje (~dupondje@artemis.dupie.be) Quit (Remote host closed the connection)
[9:20] * Shesh (~Mraedis@06SAAA27O.tor-irc.dnsbl.oftc.net) Quit ()
[9:21] * GuntherDW (~SurfMaths@06SAAA28X.tor-irc.dnsbl.oftc.net) has joined #ceph
[9:21] * linjan_ (~linjan@86.62.112.22) Quit (Ping timeout: 480 seconds)
[9:22] * rendar (~I@host127-18-dynamic.13-79-r.retail.telecomitalia.it) has joined #ceph
[9:23] * rmart04 (~rmart04@support.memset.com) has joined #ceph
[9:26] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[9:30] * linjan_ (~linjan@86.62.112.22) has joined #ceph
[9:30] * dgurtner (~dgurtner@82.199.64.68) has joined #ceph
[9:31] * haomaiwang (~haomaiwan@45.32.250.132) has joined #ceph
[9:31] * kawa2014 (~kawa@89.184.114.246) has joined #ceph
[9:32] * haomaiwang (~haomaiwan@45.32.250.132) Quit (Remote host closed the connection)
[9:32] * haomaiwang (~haomaiwan@45.32.250.132) has joined #ceph
[9:33] * haomaiwang (~haomaiwan@45.32.250.132) Quit (Remote host closed the connection)
[9:33] * haomaiwang (~haomaiwan@45.32.250.132) has joined #ceph
[9:34] * haomaiwang (~haomaiwan@45.32.250.132) Quit (Remote host closed the connection)
[9:34] * haomaiwang (~haomaiwan@45.32.250.132) has joined #ceph
[9:35] * haomaiwang (~haomaiwan@45.32.250.132) Quit (Remote host closed the connection)
[9:35] * haomaiwang (~haomaiwan@45.32.250.132) has joined #ceph
[9:36] * haomaiwang (~haomaiwan@45.32.250.132) Quit (Remote host closed the connection)
[9:36] * haomaiwang (~haomaiwan@45.32.250.132) has joined #ceph
[9:37] * haomaiwang (~haomaiwan@45.32.250.132) Quit (Remote host closed the connection)
[9:38] * nils_ (~nils_@doomstreet.collins.kg) has joined #ceph
[9:38] * haomaiwang (~haomaiwan@45.32.250.132) has joined #ceph
[9:39] * haomaiwang (~haomaiwan@45.32.250.132) Quit (Remote host closed the connection)
[9:39] * haomaiwang (~haomaiwan@45.32.250.132) has joined #ceph
[9:40] * haomaiwang (~haomaiwan@45.32.250.132) Quit (Remote host closed the connection)
[9:40] * haomaiwang (~haomaiwan@45.32.250.132) has joined #ceph
[9:40] * bjornar__ (~bjornar@109.247.131.38) has joined #ceph
[9:41] * haomaiwang (~haomaiwan@45.32.250.132) Quit (Remote host closed the connection)
[9:41] * haomaiwang (~haomaiwan@45.32.250.132) has joined #ceph
[9:42] * haomaiwang (~haomaiwan@45.32.250.132) Quit (Remote host closed the connection)
[9:43] * haomaiwang (~haomaiwan@45.32.250.132) has joined #ceph
[9:44] * haomaiwang (~haomaiwan@45.32.250.132) Quit (Remote host closed the connection)
[9:44] * haomaiwang (~haomaiwan@45.32.250.132) has joined #ceph
[9:45] * haomaiwang (~haomaiwan@45.32.250.132) Quit (Remote host closed the connection)
[9:45] * haomaiwang (~haomaiwan@45.32.250.132) has joined #ceph
[9:46] * haomaiwang (~haomaiwan@45.32.250.132) Quit (Remote host closed the connection)
[9:46] * rotbeard (~redbeard@185.32.80.238) has joined #ceph
[9:46] * haomaiwang (~haomaiwan@45.32.250.132) has joined #ceph
[9:47] * haomaiwang (~haomaiwan@45.32.250.132) Quit (Remote host closed the connection)
[9:47] * haomaiwang (~haomaiwan@45.32.250.132) has joined #ceph
[9:48] * haomaiwang (~haomaiwan@45.32.250.132) Quit (Remote host closed the connection)
[9:50] * karnan (~karnan@106.51.136.1) has joined #ceph
[9:50] * swami1 (~swami@27.7.161.87) has joined #ceph
[9:51] * GuntherDW (~SurfMaths@06SAAA28X.tor-irc.dnsbl.oftc.net) Quit ()
[9:51] * Nanobot (~Redshift@93.115.95.216) has joined #ceph
[9:51] * TMM (~hp@178-84-46-106.dynamic.upc.nl) Quit (Quit: Ex-Chat)
[9:55] * bara (~bara@nat-pool-brq-t.redhat.com) has joined #ceph
[9:56] * karnan (~karnan@106.51.136.1) Quit (Quit: Leaving)
[9:59] * DanFoster (~Daniel@2a00:1ee0:3:1337:8da5:320c:5638:247e) has joined #ceph
[10:02] * farblue (~farblue@wor.namesco.net) has joined #ceph
[10:05] * ade (~abradshaw@212.77.58.61) Quit (Ping timeout: 480 seconds)
[10:10] * evelu (~erwan@37.160.107.217) has joined #ceph
[10:12] * jordanP (~jordan@204.13-14-84.ripe.coltfrance.com) has joined #ceph
[10:12] <nils_> so I notice ceph is using TCMalloc as a memory allocator, is there a certain impact when using transparent hugepages? Should I disable them?
[10:15] <nils_> I'm actually looking into some memory fragmentation issues I have sine I formatted some OSDs with different xfs setting (namely -n size=64k)
[10:16] <DanFoster> http://www.sebastien-han.fr/blog/2015/09/07/the-ceph-and-tcmalloc-performance-story/ might prove an interesting read, nils_ :)
[10:17] <nils_> thank's, I've been googling around already as this may be another avenue for me to pursue in my research into this xfs problem - the issue I have is that xfs sometimes will stall out when it can't allocate 64k of contiguous memory in the kernel
[10:17] <nils_> currently I have a cron job that checks if 64k pages are available and if not runs memory compaction
[10:17] * swami1 (~swami@27.7.161.87) Quit (Quit: Leaving.)
[10:18] <nils_> sort of a deep dive into the kernel VM system that I wasn't really planning on ;)
[10:21] * Nanobot (~Redshift@6AGAAALE7.tor-irc.dnsbl.oftc.net) Quit ()
[10:21] <nils_> DanFoster, riveting, so running ubuntu trusty my recourse would be to rebuild ceph using jemalloc...
[10:22] <DanFoster> I haven't done anything with that information, just remember reading it :)
[10:22] <nils_> yeah I just know that jemalloc has some issues with transparent hugepages (tokuMX / redis complaining when you start it even)
[10:25] * Sun7zu (~Tenk@94.242.228.107) has joined #ceph
[10:28] * Geph (~Geoffrey@41.77.153.99) has joined #ceph
[10:29] * Lea (~LeaChim@host86-159-239-193.range86-159.btcentralplus.com) has joined #ceph
[10:29] * krypto (~krypto@sessfw99-sesbfw99-85.ericsson.net) Quit (Ping timeout: 480 seconds)
[10:30] * krypto (~krypto@G68-90-105-70.sbcis.sbc.com) has joined #ceph
[10:38] * rendar (~I@host127-18-dynamic.13-79-r.retail.telecomitalia.it) Quit (Ping timeout: 480 seconds)
[10:42] * rendar (~I@host127-18-dynamic.13-79-r.retail.telecomitalia.it) has joined #ceph
[10:43] * olid19811115 (~olid1982@aftr-185-17-206-53.dynamic.mnet-online.de) has joined #ceph
[10:45] * efirs (~firs@c-50-185-70-125.hsd1.ca.comcast.net) Quit (Quit: Leaving.)
[10:48] * _28_ria (~kvirc@opfr028.ru) Quit (Read error: Connection reset by peer)
[10:48] * krypto (~krypto@G68-90-105-70.sbcis.sbc.com) Quit (Read error: Connection reset by peer)
[10:48] * _28_ria (~kvirc@opfr028.ru) has joined #ceph
[10:48] * krypto (~krypto@sessfw99-sesbfw99-81.ericsson.net) has joined #ceph
[10:51] * TMM (~hp@185.5.122.2) has joined #ceph
[10:53] * fsimonce (~simon@host201-70-dynamic.26-79-r.retail.telecomitalia.it) has joined #ceph
[10:55] * krypto (~krypto@sessfw99-sesbfw99-81.ericsson.net) Quit (Read error: Connection reset by peer)
[10:55] * Sun7zu (~Tenk@4MJAAD217.tor-irc.dnsbl.oftc.net) Quit ()
[10:55] * rraja (~rraja@121.244.87.117) has joined #ceph
[10:55] * krypto (~krypto@103.252.27.3) has joined #ceph
[10:58] <loicd> https://www.youtube.com/watch?v=rmgYvRwDf4A&index=3&list=PLTvZBPQxCI8GZvERUrxAXMqHq_eQ2nD41&html5=True Ceph - Distributed Storage System in OVH
[10:58] <loicd> for the record, to not loose the link ;_0
[11:00] * Aramande_ (~Kwen@hessel2.torservers.net) has joined #ceph
[11:06] <BranchPredictor> I think i recognize the name of presenter...
[11:18] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) has joined #ceph
[11:21] * MrAbaddon (~MrAbaddon@193.137.26.66) has joined #ceph
[11:24] * aj__ (~aj@2001:6f8:1337:0:bced:8cc8:5c89:6253) has joined #ceph
[11:25] * BlaXpirit (~irc@blaxpirit.com) Quit (Quit: Bye)
[11:25] * karnan (~karnan@106.51.136.1) has joined #ceph
[11:25] * krypto (~krypto@103.252.27.3) Quit (Ping timeout: 480 seconds)
[11:26] * krypto (~krypto@sessfw99-sesbfw99-83.ericsson.net) has joined #ceph
[11:26] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[11:27] * IvanJobs (~hardes@103.50.11.146) has joined #ceph
[11:27] * zwu (~root@58.135.81.96) has joined #ceph
[11:30] * Aramande_ (~Kwen@06SAAA3CY.tor-irc.dnsbl.oftc.net) Quit ()
[11:30] * Revo841 (~Hideous@tor-exit.dhalgren.org) has joined #ceph
[11:34] * BlaXpirit (~irc@blaxpirit.com) has joined #ceph
[11:35] * evelu (~erwan@37.160.107.217) Quit (Ping timeout: 480 seconds)
[11:38] <TMM> I have an interesting problem. It appears that in my cluster I get slow requests when there are OSDs in connecting or peering state. Actual backfills and recoveries don't cause any problems.
[11:38] <TMM> I see slow requests until right before I see no more connecting/peering events in my logs
[11:39] <Gugge-47527> i solved that by never starting more than one osd at once
[11:39] <TMM> the problem is that it also happens when a host disappears unexpectedly
[11:40] <TMM> (this is on hammer btw)
[11:41] <Gugge-47527> i dont, but maybe that is because i have set my cluster to not out the osd's automatically
[11:44] * evelu (~erwan@37.163.70.251) has joined #ceph
[11:52] * yanzheng (~zhyan@118.116.113.6) Quit (Quit: This computer has gone to sleep)
[11:57] <etienneme> It's maybe because of strong consistency. When you have a request, it could take a lot of times before ceph is sure of consistency. When an OSD is connecting/peering i would not be surprised that there is a full check of objects
[12:00] * Revo841 (~Hideous@76GAAD8PO.tor-irc.dnsbl.oftc.net) Quit ()
[12:00] * zhaochao_ (~zhaochao@125.39.9.144) has joined #ceph
[12:05] * zhaochao (~zhaochao@125.39.9.156) Quit (Ping timeout: 480 seconds)
[12:05] * zhaochao_ is now known as zhaochao
[12:07] <TMM> I do have EC pools
[12:07] <TMM> in 2+1 mode
[12:08] <TMM> would it be better if I increase k+m?
[12:12] * krypto (~krypto@sessfw99-sesbfw99-83.ericsson.net) Quit (Read error: Connection reset by peer)
[12:13] * krypto (~krypto@sessfw99-sesbfw99-83.ericsson.net) has joined #ceph
[12:14] * wjw-freebsd (~wjw@smtp.digiware.nl) Quit (Ping timeout: 480 seconds)
[12:18] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) has joined #ceph
[12:26] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[12:30] * Shadow386 (~neobenedi@6AGAAALK9.tor-irc.dnsbl.oftc.net) has joined #ceph
[12:30] * EinstCrazy (~EinstCraz@58.247.119.250) Quit (Remote host closed the connection)
[12:30] * zaitcev (~zaitcev@c-50-130-189-82.hsd1.nm.comcast.net) Quit (Quit: Bye)
[12:46] * ade (~abradshaw@212.77.58.61) has joined #ceph
[12:47] * Mika_c (~quassel@122.146.93.152) Quit (Remote host closed the connection)
[12:50] * linjan_ (~linjan@86.62.112.22) Quit (Ping timeout: 480 seconds)
[12:58] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:f1df:eece:45c6:3086) has joined #ceph
[13:00] * Shadow386 (~neobenedi@6AGAAALK9.tor-irc.dnsbl.oftc.net) Quit ()
[13:01] * kefu is now known as kefu|afk
[13:06] * ade (~abradshaw@212.77.58.61) Quit (Ping timeout: 480 seconds)
[13:06] * rwheeler (~rwheeler@pool-173-48-195-215.bstnma.fios.verizon.net) Quit (Quit: Leaving)
[13:12] * IvanJobs (~hardes@103.50.11.146) Quit (Quit: Leaving)
[13:13] <nils_> is this still available somewhere? http://nhm.ceph.com/hackathon/Ceph_Hackathon_Memory_Allocator_Testing.pdf
[13:13] * wjw-freebsd (~wjw@176.74.240.1) has joined #ceph
[13:15] * DanFoster (~Daniel@2a00:1ee0:3:1337:8da5:320c:5638:247e) Quit (Quit: Leaving)
[13:18] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) has joined #ceph
[13:19] <etienneme> nils_: http://ceph.com/wp-content/uploads/2016/02/Ceph_Hackathon_Memory_Allocator_Testing.pdf ?
[13:19] <nils_> etienneme, great thanks
[13:21] * vicente (~~vicente@125-227-238-55.HINET-IP.hinet.net) Quit (Quit: Leaving)
[13:26] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[13:30] * ain (~AotC@tor2e1.privacyfoundation.ch) has joined #ceph
[13:35] * wyang (~wyang@116.216.30.3) has joined #ceph
[13:39] * yang_ (~wyang@122.225.69.23) has joined #ceph
[13:41] * i_m (~ivan.miro@deibp9eh1--blueice3n1.emea.ibm.com) has joined #ceph
[13:44] * wyang (~wyang@116.216.30.3) Quit (Ping timeout: 480 seconds)
[13:47] * zhaochao (~zhaochao@125.39.9.144) Quit (Quit: ChatZilla 0.9.92 [Firefox 45.0.1/20160318172635])
[13:50] * georgem (~Adium@24.114.65.88) has joined #ceph
[13:52] * ira (~ira@c-24-34-255-34.hsd1.ma.comcast.net) has joined #ceph
[13:55] * rotbeard (~redbeard@185.32.80.238) Quit (Quit: Leaving)
[13:56] * ira (~ira@c-24-34-255-34.hsd1.ma.comcast.net) Quit ()
[13:56] * ira (~ira@c-24-34-255-34.hsd1.ma.comcast.net) has joined #ceph
[14:00] * ain (~AotC@6AGAAALNY.tor-irc.dnsbl.oftc.net) Quit ()
[14:00] * Jyron (~Pommesgab@hessel3.torservers.net) has joined #ceph
[14:07] * Concubidated (~cube@c-50-173-245-118.hsd1.ca.comcast.net) Quit (Quit: Leaving.)
[14:13] * wjw-freebsd2 (~wjw@176.74.240.1) has joined #ceph
[14:17] * wjw-freebsd (~wjw@176.74.240.1) Quit (Ping timeout: 480 seconds)
[14:18] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) has joined #ceph
[14:21] * haomaiwang (~haomaiwan@45.32.250.132) has joined #ceph
[14:22] * haomaiwang (~haomaiwan@45.32.250.132) Quit (Remote host closed the connection)
[14:22] * bniver (~bniver@71-9-144-29.static.oxfr.ma.charter.com) has joined #ceph
[14:22] * haomaiwang (~haomaiwan@45.32.250.132) has joined #ceph
[14:23] * haomaiwang (~haomaiwan@45.32.250.132) Quit (Remote host closed the connection)
[14:23] * haomaiwang (~haomaiwan@45.32.250.132) has joined #ceph
[14:24] * haomaiwang (~haomaiwan@45.32.250.132) Quit (Remote host closed the connection)
[14:24] * haomaiwang (~haomaiwan@45.32.250.132) has joined #ceph
[14:25] * haomaiwang (~haomaiwan@45.32.250.132) Quit (Remote host closed the connection)
[14:25] * haomaiwang (~haomaiwan@45.32.250.132) has joined #ceph
[14:25] * kefu|afk is now known as kefu
[14:26] * haomaiwang (~haomaiwan@45.32.250.132) Quit (Remote host closed the connection)
[14:26] * haomaiwang (~haomaiwan@45.32.250.132) has joined #ceph
[14:26] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[14:27] * haomaiwang (~haomaiwan@45.32.250.132) Quit (Remote host closed the connection)
[14:27] * haomaiwang (~haomaiwan@45.32.250.132) has joined #ceph
[14:28] * haomaiwang (~haomaiwan@45.32.250.132) Quit (Remote host closed the connection)
[14:28] * yang_ (~wyang@122.225.69.23) Quit (Quit: This computer has gone to sleep)
[14:28] * haomaiwang (~haomaiwan@45.32.250.132) has joined #ceph
[14:28] * georgem (~Adium@24.114.65.88) Quit (Read error: Connection reset by peer)
[14:29] * haomaiwang (~haomaiwan@45.32.250.132) Quit (Remote host closed the connection)
[14:29] * haomaiwang (~haomaiwan@45.32.250.132) has joined #ceph
[14:30] * haomaiwang (~haomaiwan@45.32.250.132) Quit (Remote host closed the connection)
[14:30] * Jyron (~Pommesgab@06SAAA3I5.tor-irc.dnsbl.oftc.net) Quit ()
[14:30] * Tarazed (~Aramande_@tor-exit-node.seas.upenn.edu) has joined #ceph
[14:30] * haomaiwang (~haomaiwan@s16.ezlink.hk) has joined #ceph
[14:31] * haomaiwang (~haomaiwan@s16.ezlink.hk) Quit (Remote host closed the connection)
[14:31] * haomaiwang (~haomaiwan@s16.ezlink.hk) has joined #ceph
[14:32] * haomaiwang (~haomaiwan@s16.ezlink.hk) Quit (Remote host closed the connection)
[14:32] * haomaiwang (~haomaiwan@s16.ezlink.hk) has joined #ceph
[14:33] * haomaiwang (~haomaiwan@s16.ezlink.hk) Quit (Remote host closed the connection)
[14:33] * haomaiwang (~haomaiwan@s16.ezlink.hk) has joined #ceph
[14:33] * bene2 (~bene@50.153.132.4) has joined #ceph
[14:33] * haomaiwang (~haomaiwan@s16.ezlink.hk) Quit ()
[14:34] * pdrakeweb (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) Quit (Read error: Connection reset by peer)
[14:35] * pdrakeweb (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) has joined #ceph
[14:37] * bene3 (~bene@2601:18c:8501:25e4:ea2a:eaff:fe08:3c7a) has joined #ceph
[14:38] * atheism (~atheism@182.48.117.114) Quit (Ping timeout: 480 seconds)
[14:38] * RameshN (~rnachimu@121.244.87.117) Quit (Ping timeout: 480 seconds)
[14:42] * bene2 (~bene@50.153.132.4) Quit (Ping timeout: 480 seconds)
[14:48] * georgem (~Adium@206.108.127.16) has joined #ceph
[14:55] * Concubidated (~cube@c-50-173-245-118.hsd1.ca.comcast.net) has joined #ceph
[14:57] * huangjun (~kvirc@117.151.48.89) has joined #ceph
[14:57] * mhack (~mhack@nat-pool-bos-t.redhat.com) has joined #ceph
[14:58] * EinstCrazy (~EinstCraz@58.39.19.226) has joined #ceph
[15:00] * Tarazed (~Aramande_@6AGAAALQY.tor-irc.dnsbl.oftc.net) Quit ()
[15:00] * bene3 (~bene@2601:18c:8501:25e4:ea2a:eaff:fe08:3c7a) Quit (Quit: Konversation terminated!)
[15:00] * Harryhy1 (~zapu@4MJAAD29A.tor-irc.dnsbl.oftc.net) has joined #ceph
[15:07] <TMM> ah, no, my ecprofile is k=7,m=3
[15:07] <TMM> not 2,1
[15:09] * wyang (~wyang@114.111.166.43) has joined #ceph
[15:10] * pabluk__ is now known as pabluk_
[15:12] <TMM> k=7,m=3,plugin=isa,technique=cauchy
[15:13] * wjw-freebsd (~wjw@176.74.240.1) has joined #ceph
[15:16] * pabluk_ is now known as pabluk__
[15:17] * EinstCrazy (~EinstCraz@58.39.19.226) Quit (Remote host closed the connection)
[15:17] * wyang (~wyang@114.111.166.43) Quit (Quit: This computer has gone to sleep)
[15:18] * wjw-freebsd2 (~wjw@176.74.240.1) Quit (Ping timeout: 480 seconds)
[15:18] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) has joined #ceph
[15:18] <huangjun> what about stripe_width?
[15:22] * EinstCrazy (~EinstCraz@58.39.19.226) has joined #ceph
[15:22] * wyang (~wyang@122.225.69.23) has joined #ceph
[15:23] * dgurtner (~dgurtner@82.199.64.68) Quit (Ping timeout: 480 seconds)
[15:24] * Miouge (~Miouge@94.136.92.20) Quit (Ping timeout: 480 seconds)
[15:24] * Miouge_ is now known as Miouge
[15:25] * brad_mssw (~brad@66.129.88.50) has joined #ceph
[15:25] * wyang (~wyang@122.225.69.23) Quit ()
[15:26] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[15:29] * beardo_ (~sma310@207-172-244-241.c3-0.atw-ubr5.atw.pa.cable.rcn.com) Quit (Remote host closed the connection)
[15:30] * Harryhy1 (~zapu@4MJAAD29A.tor-irc.dnsbl.oftc.net) Quit ()
[15:30] * Shnaw (~aldiyen@4MJAAD292.tor-irc.dnsbl.oftc.net) has joined #ceph
[15:30] * wyang (~wyang@116.216.30.3) has joined #ceph
[15:31] * EinstCrazy (~EinstCraz@58.39.19.226) Quit (Remote host closed the connection)
[15:33] <TMM> huangjun, I haven't set it explicitely
[15:33] * T1w (~jens@node3.survey-it.dk) Quit (Ping timeout: 480 seconds)
[15:33] <huangjun> you can get it by "ceph osd dump|grep $POOL"
[15:34] * dgurtner (~dgurtner@87.215.61.26) has joined #ceph
[15:36] * wwdillingham (~LobsterRo@65.112.8.197) has joined #ceph
[15:36] <TMM> stripe_width 4256
[15:36] <TMM> for all my EC pools
[15:36] * wushudoin (~wushudoin@38.140.108.2) Quit (Ping timeout: 480 seconds)
[15:41] * Miouge (~Miouge@h-72-233.a163.priv.bahnhof.se) Quit (Quit: Miouge)
[15:43] * Miouge (~Miouge@h-72-233.a163.priv.bahnhof.se) has joined #ceph
[15:44] * Miouge (~Miouge@h-72-233.a163.priv.bahnhof.se) Quit ()
[15:45] * wushudoin (~wushudoin@38.140.108.2) has joined #ceph
[15:47] * vikhyat (~vumrao@121.244.87.116) Quit (Quit: Leaving)
[15:48] * dgurtner_ (~dgurtner@82.199.64.68) has joined #ceph
[15:50] * dgurtner (~dgurtner@87.215.61.26) Quit (Ping timeout: 480 seconds)
[15:50] * EinstCrazy (~EinstCraz@58.39.19.226) has joined #ceph
[15:51] * karnan (~karnan@106.51.136.1) Quit (Quit: Leaving)
[15:51] * yang_ (~wyang@114.111.166.43) has joined #ceph
[15:52] <ska> What is the difference between 'reweight' in calamari api's osd target, and the weight attibute in 'ceph osd dump -fjson-pretty'.osds ?
[15:52] * rraja (~rraja@121.244.87.117) Quit (Quit: Leaving)
[15:53] <ska> if you have the ceph cli dumped to file for example: jq .osds[1].weight osd-ok.json
[15:55] <ska> They look like the same value.
[15:56] * wyang (~wyang@116.216.30.3) Quit (Ping timeout: 480 seconds)
[15:57] * atheism (~atheism@219.143.82.153) has joined #ceph
[15:58] * Concubidated (~cube@c-50-173-245-118.hsd1.ca.comcast.net) Quit (Quit: Leaving.)
[15:58] * EinstCrazy (~EinstCraz@58.39.19.226) Quit (Ping timeout: 480 seconds)
[16:00] * Shnaw (~aldiyen@4MJAAD292.tor-irc.dnsbl.oftc.net) Quit ()
[16:00] <ska> I'm thinking that reweight is an action, so that the API should probably be showing weight instead.
[16:00] * zviratko (~Averad@46.182.106.190) has joined #ceph
[16:05] * wwdillingham (~LobsterRo@65.112.8.197) Quit (Quit: wwdillingham)
[16:07] * rlord (~rlord@c-24-34-70-97.hsd1.nh.comcast.net) has joined #ceph
[16:08] * wwdillingham (~LobsterRo@65.112.8.197) has joined #ceph
[16:08] * ToMiles (~ToMiles@medgents.ugent.be) has joined #ceph
[16:08] * shaunm (~shaunm@74.83.215.100) Quit (Ping timeout: 480 seconds)
[16:08] * xarses (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[16:10] <ToMiles> Any reason why a ceph cluster in a HEALTH_OK state would continuously deep scrub the same 5 PG's ?
[16:12] <ToMiles> 5.e1 scrub starts -> 5.e1 scrub ok ...
[16:14] * wjw-freebsd2 (~wjw@176.74.240.1) has joined #ceph
[16:18] * yang_ (~wyang@114.111.166.43) Quit (Quit: This computer has gone to sleep)
[16:18] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) has joined #ceph
[16:20] * wjw-freebsd (~wjw@176.74.240.1) Quit (Ping timeout: 480 seconds)
[16:21] * yanzheng (~zhyan@118.116.113.6) has joined #ceph
[16:22] * aj__ (~aj@2001:6f8:1337:0:bced:8cc8:5c89:6253) Quit (Ping timeout: 480 seconds)
[16:22] <ska> Maybe they are damaged and scrubbing allows temporary relief.
[16:23] <ska> Damaged at hardware/OS level.
[16:24] * tafelpoot (~Hannes@hygeia.opentp.be) has joined #ceph
[16:24] <ToMiles> I would think the same thing but disk scans dont report errors and de 5 pg are not all connected with a specific OSD
[16:26] <ToMiles> and there is no errors reported in osd log just repeating scrub start -> ok very 1 to 3 seconds
[16:26] * wushudoin (~wushudoin@38.140.108.2) Quit (Ping timeout: 480 seconds)
[16:26] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[16:27] <tafelpoot> hi all, I am setting up a ceph cluster but I have a little issue. When I try to throw a big file to it, it goes very slow. Nothing seems overloaded (cpu, disk, networking, memory) but I'm not able to reach speeds of over 25MBps, When I benchmark the system with 16 concurrent threads, I am able to reach 100MBps. Anyone an idea how I can optimize the performance when writing a big object (7TB) to the cluster at a good speed?
[16:29] * allaok (~allaok@machine107.orange-labs.com) Quit (Quit: Leaving.)
[16:30] * zviratko (~Averad@6AGAAALV7.tor-irc.dnsbl.oftc.net) Quit ()
[16:30] * Kidlvr (~rushworld@06SAAA3P4.tor-irc.dnsbl.oftc.net) has joined #ceph
[16:30] <tafelpoot> I checked the seperate parts (disks using DD, network using iperf, ...) and everything is really good
[16:31] <tafelpoot> but when writing 1 big file, the troughput goes down
[16:33] * dgurtner_ (~dgurtner@82.199.64.68) Quit (Ping timeout: 480 seconds)
[16:33] * EinstCrazy (~EinstCraz@58.39.19.226) has joined #ceph
[16:34] <tafelpoot> maybe some docs you could point at?
[16:37] * EinstCrazy (~EinstCraz@58.39.19.226) Quit (Remote host closed the connection)
[16:37] <ToMiles> what is the source of your big file/object and how you writing it to the cluster?
[16:37] * rlord (~rlord@c-24-34-70-97.hsd1.nh.comcast.net) Quit (Read error: Connection reset by peer)
[16:38] * wushudoin (~wushudoin@38.140.108.2) has joined #ceph
[16:38] * yanzheng (~zhyan@118.116.113.6) Quit (Quit: This computer has gone to sleep)
[16:39] * haplo37 (~haplo37@24-50-67-141.ri.cgocable.ca) has joined #ceph
[16:41] * vata (~vata@cable-21.246.173-197.electronicbox.net) has joined #ceph
[16:43] <TMM> ok I have my problem with slow requests during peering again right now
[16:43] <TMM> What should I look at?
[16:44] <tafelpoot> ToMiles: the source is a backup (a tar file) and I push it to my cluster using rados
[16:45] <tafelpoot> I have used 2 pools, one with replication and one with erasure
[16:46] <TMM> I also ahve some hung tasks in dmesg :-/
[16:46] * koma (~koma@0001c112.user.oftc.net) has joined #ceph
[16:47] * ade (~abradshaw@80-254-69-119.dynamic.monzoon.net) has joined #ceph
[16:47] <ToMiles> from a local disk?
[16:48] <TMM> yeah
[16:48] <ToMiles> sorry was for tafelpoot
[16:48] * xarses (~xarses@64.124.158.100) has joined #ceph
[16:49] <tafelpoot> I have a 3 node cluster with 4 disks on each node. I push the big file from a 4th server
[16:49] <tafelpoot> so the 12 disks are only coping with writing the data to disk
[16:49] * ade (~abradshaw@80-254-69-119.dynamic.monzoon.net) Quit ()
[16:50] <TMM> I also see a lot of osds complaining about being wrongly marked down
[16:50] * mhack (~mhack@nat-pool-bos-t.redhat.com) Quit (Ping timeout: 480 seconds)
[16:51] <ToMiles> Depending on where it reads the file from I would expect it to be slower for one file compared to multiple concurrently read input sources
[16:52] <tafelpoot> but I am able to scp the file at approx 48MB/s :s
[16:52] <tafelpoot> from that one server to 1 of the 3 ceph nodes (to make sure the "path" the data takes is the same)
[16:53] * EinstCrazy (~EinstCraz@58.39.19.226) has joined #ceph
[16:53] <tafelpoot> I gotta run but I'll be able to read this when I'm home
[16:54] <tafelpoot> so, if you know things to try or things to look into, please tell me!
[16:57] * mattbenjamin (~mbenjamin@aa2.linuxbox.com) has joined #ceph
[16:58] * analbeard (~shw@support.memset.com) Quit (Quit: Leaving.)
[16:59] <rmart04> TMM, still battling? Has it not resynced yet?!
[16:59] <TMM> rmart04, it has now
[17:00] * Kidlvr (~rushworld@06SAAA3P4.tor-irc.dnsbl.oftc.net) Quit ()
[17:00] <TMM> rmart04, it does fix itself eventually but the slow requests last for 20 minutes each time anything goes wrong
[17:01] <TMM> only one OSD failed this time
[17:01] <TMM> it appears it lost a drive
[17:02] * bjornar__ (~bjornar@109.247.131.38) Quit (Ping timeout: 480 seconds)
[17:02] <TMM> oh... That drive actually failed yesterday
[17:02] <TMM> weird
[17:02] * EinstCrazy (~EinstCraz@58.39.19.226) Quit (Remote host closed the connection)
[17:07] <TMM> it's weird though, I see slow requests all over the cluster when a single osd goes down, but only while there are still osds in peering mode
[17:09] * wushudoin (~wushudoin@38.140.108.2) Quit (Ping timeout: 480 seconds)
[17:12] * wushudoin (~wushudoin@38.140.108.2) has joined #ceph
[17:14] * wjw-freebsd (~wjw@176.74.240.1) has joined #ceph
[17:18] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) has joined #ceph
[17:19] * wjw-freebsd2 (~wjw@176.74.240.1) Quit (Ping timeout: 480 seconds)
[17:21] * derjohn_mob (~aj@tmo-109-26.customers.d1-online.com) has joined #ceph
[17:21] * rlord_ (~rlord@c-24-34-70-97.hsd1.nh.comcast.net) has joined #ceph
[17:22] * reed (~reed@75-101-54-18.dsl.static.fusionbroadband.com) has joined #ceph
[17:25] * wushudoin (~wushudoin@38.140.108.2) Quit (Ping timeout: 480 seconds)
[17:26] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[17:29] <georgem> TMM: any iptables, ulimit issues maybe?
[17:29] * LDA (~lda@host217-114-156-249.pppoe.mark-itt.net) has joined #ceph
[17:29] <TMM> no, that can't really be the issue
[17:30] <TMM> it only happens during peering, but everything does eventually peer
[17:30] * Frymaster (~Tumm@tor1e1.privacyfoundation.ch) has joined #ceph
[17:30] <ToMiles> I've set noscrub flag for now to avoid further scrubbing of the same 5 pgs
[17:30] <TMM> nofiles limit is 131072
[17:30] <TMM> per osd
[17:30] <TMM> I doubt that's the problem either
[17:32] <georgem> TMM: anything useful in the OSD logs when peering is slow?
[17:33] * derjohn_mob (~aj@tmo-109-26.customers.d1-online.com) Quit (Ping timeout: 480 seconds)
[17:34] * rmart04 (~rmart04@support.memset.com) Quit (Quit: rmart04)
[17:35] <TMM> not really
[17:37] <georgem> TMM: how many OSDs do you have ?
[17:40] * derjohn_mob (~aj@p5B025657.dip0.t-ipconnect.de) has joined #ceph
[17:40] * DV_ (~veillard@2001:41d0:a:f29f::1) Quit (Ping timeout: 480 seconds)
[17:40] * kefu (~kefu@114.92.120.83) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[17:41] * mhack (~mhack@nat-pool-bos-t.redhat.com) has joined #ceph
[17:41] * rlord_ (~rlord@c-24-34-70-97.hsd1.nh.comcast.net) has left #ceph
[17:42] <georgem> TMM: the peering process is described in detail here: http://docs.ceph.com/docs/master/dev/peering/
[17:43] * kefu (~kefu@183.193.127.235) has joined #ceph
[17:43] <georgem> TMM: I made these changes to reduce the number of maps kept and exchanged: http://lists.ceph.com/pipermail/ceph-users-ceph.com/2015-December/006456.html
[17:43] * bjornar__ (~bjornar@ti0099a430-1561.bb.online.no) has joined #ceph
[17:45] * Skaag (~lunix@cpe-172-91-77-84.socal.res.rr.com) Quit (Quit: Leaving.)
[17:46] <TMM> georgem, I have 232 OSDs but most pools can only be on 116 of them
[17:47] * kefu_ (~kefu@114.92.120.83) has joined #ceph
[17:47] <TMM> georgem, are those values different from the hammer defaults?
[17:48] <georgem> TMM: yes, you can see your current values by dumping the running config
[17:48] <TMM> georgem, what did those changes do for your cluster?
[17:50] * derjohn_mob (~aj@p5B025657.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[17:51] <georgem> TMM: the idea is to reduce the amount of memory used to store all these maps; if you read the recommendation that came from CERN after they tested with around 7000 OSDs (https://cds.cern.ch/record/2015206/files/CephScaleTestMarch2015.pdf); it's not a problem I had but it's better to use that memory for caching reads that storing useless maps
[17:51] <TMM> sure
[17:51] * kefu (~kefu@183.193.127.235) Quit (Ping timeout: 480 seconds)
[17:51] <TMM> but I'd rather not touch any knobs while I'm still debugging a problem
[17:52] <georgem> TMM: can you easily reproduce the problem?
[17:53] <georgem> TMM: if yes, then you can try different things, like implement these changes http://fatmin.com/2015/08/19/ceph-tcp-performance-tuning/
[17:53] <TMM> Well, I just replicated what I thought was the problem and it didn't happen
[17:54] <TMM> after I turned off numad on all my osds
[17:54] <georgem> TMM:of course, it would be best if you could find out the number of established connection, capture the traffic when the OSD peering is slow to see if there are dropped packets, retries, etc
[17:54] <TMM> my current hypothesis is that with all the peerings numad keeps moving threads around the numa nodes
[17:55] <TMM> when I see no more numad in top, the slow requests also stop
[17:55] <TMM> now, this may be correlation rather than causation of course
[17:55] <TMM> but at least I've constructed a narrative for myself that seems to make sense :P
[17:55] * i_m (~ivan.miro@deibp9eh1--blueice3n1.emea.ibm.com) Quit (Read error: Connection reset by peer)
[17:56] <TMM> I do notice that according to the extfrag/unusable_index there's a lot of memory fragmentation making order 5 - 10 allocations currently impossible
[17:56] <TMM> on a system that was having slow requests during peering
[17:56] <TMM> so that may also be a problem
[17:56] * EinstCrazy (~EinstCraz@58.39.19.226) has joined #ceph
[17:57] * Geph (~Geoffrey@41.77.153.99) Quit (Ping timeout: 480 seconds)
[17:58] * shaunm (~shaunm@cpe-192-180-18-62.kya.res.rr.com) has joined #ceph
[17:58] * Be-El (~blinke@nat-router.computational.bio.uni-giessen.de) Quit (Quit: Leaving.)
[17:58] * EinstCrazy (~EinstCraz@58.39.19.226) Quit (Remote host closed the connection)
[17:58] * Concubidated (~cube@c-50-173-245-118.hsd1.ca.comcast.net) has joined #ceph
[18:00] * Frymaster (~Tumm@4MJAAD3ER.tor-irc.dnsbl.oftc.net) Quit ()
[18:00] * Chrissi_ (~ZombieL@edwardsnowden1.torservers.net) has joined #ceph
[18:00] <georgem> TMM: possibly, can you send an email on the mailing list after you find and the issue and what worked for you to fix it, so it's indexed and we all know in the future?
[18:01] * wwdillingham (~LobsterRo@65.112.8.197) Quit (Quit: wwdillingham)
[18:01] <TMM> yeah
[18:01] <TMM> I have a bunch of small things, could be useful for posterity I suppose
[18:02] <TMM> I'm not yet sure if this is in fact the problem though. And the high memory fragmentation kind of worries me too
[18:03] * Miouge (~Miouge@h-72-233.a163.priv.bahnhof.se) has joined #ceph
[18:08] * derjohn_mob (~aj@p4FFD26E6.dip0.t-ipconnect.de) has joined #ceph
[18:10] * jklare (~jklare@185.27.181.36) Quit (Quit: ZNC - http://znc.in)
[18:11] * jklare (~jklare@185.27.181.36) has joined #ceph
[18:12] * farblue (~farblue@wor.namesco.net) Quit (Quit: farblue)
[18:12] * atheism (~atheism@219.143.82.153) Quit (Ping timeout: 480 seconds)
[18:14] * kawa2014 (~kawa@89.184.114.246) Quit (Quit: Leaving)
[18:14] * wjw-freebsd2 (~wjw@176.74.240.1) has joined #ceph
[18:15] * nils_ (~nils_@doomstreet.collins.kg) Quit (Quit: This computer has gone to sleep)
[18:18] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) has joined #ceph
[18:19] * wjw-freebsd (~wjw@176.74.240.1) Quit (Ping timeout: 480 seconds)
[18:21] * wushudoin (~wushudoin@2601:646:8201:7769:2ab2:bdff:fe0b:a6ee) has joined #ceph
[18:21] * TMM (~hp@185.5.122.2) Quit (Quit: Ex-Chat)
[18:23] * ToMiles (~ToMiles@medgents.ugent.be) Quit (Ping timeout: 480 seconds)
[18:26] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[18:28] * vbellur (~vijay@71.234.224.255) Quit (Ping timeout: 480 seconds)
[18:30] * Chrissi_ (~ZombieL@4MJAAD3FS.tor-irc.dnsbl.oftc.net) Quit ()
[18:30] * blip2 (~Hazmat@tor-exit.ohdoom.net) has joined #ceph
[18:44] * huangjun (~kvirc@117.151.48.89) Quit (Ping timeout: 480 seconds)
[18:44] * wjw-freebsd2 (~wjw@176.74.240.1) Quit (Ping timeout: 480 seconds)
[18:47] * rmart04 (~rmart04@host86-191-132-117.range86-191.btcentralplus.com) has joined #ceph
[18:48] * rmart04 (~rmart04@host86-191-132-117.range86-191.btcentralplus.com) Quit ()
[18:52] * jordanP (~jordan@204.13-14-84.ripe.coltfrance.com) Quit (Quit: Leaving)
[18:52] * vasu (~vasu@c-73-231-60-138.hsd1.ca.comcast.net) has joined #ceph
[18:53] * Miouge (~Miouge@h-72-233.a163.priv.bahnhof.se) Quit (Quit: Miouge)
[19:00] * blip2 (~Hazmat@4MJAAD3GS.tor-irc.dnsbl.oftc.net) Quit ()
[19:00] * Shnaw (~TGF@ns316491.ip-37-187-129.eu) has joined #ceph
[19:03] * bara (~bara@nat-pool-brq-t.redhat.com) Quit (Quit: Bye guys! (??????????????????? ?????????)
[19:03] * branto (~branto@178-253-132-82.3pp.slovanet.sk) Quit (Quit: Leaving.)
[19:06] * rdias (~rdias@2001:8a0:749a:d01:84a9:ad7:2a25:566d) Quit (Ping timeout: 480 seconds)
[19:07] <LDA> emm about image-format 2
[19:07] <LDA> rbd create files --size 200000 --image-format 2
[19:07] <LDA> rbd map files
[19:07] <LDA> >rbd: sysfs write failed
[19:07] <LDA> >rbd: map failed: (6) No such device or address
[19:07] <LDA> uname -r
[19:07] <LDA> >4.1.15-8-default
[19:08] <LDA> lsmod | grep rbd
[19:08] <LDA> >rbd 77824 0
[19:08] <LDA> >libceph 294912 1 rbd
[19:08] <LDA> ceph -v
[19:08] <LDA> ceph version 10.1.0-12-ge739ff1a (e739ff1a30839eb118f7672269fc746249d052f2)
[19:08] <jdillaman> LDA: with Jewel, RBD images default to features unsupported by the kernel
[19:08] <rkeene> LDA, Do you have sysfs mounted ?
[19:08] <LDA> image format 2 on rbd cli not supported?
[19:08] <rkeene> Ah, jewel
[19:08] <jdillaman> LDA: you need to specify "--image-feature layering" when creating your images
[19:09] <LDA> set layering?
[19:09] <jdillaman> LDA: or dynamically disable the unsupported features later via "rbd feature disable <image> <feature>"
[19:09] * kefu_ (~kefu@114.92.120.83) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[19:09] <jdillaman> LDA: that was the pre-Jewel default
[19:09] <LDA> ok, wait release
[19:10] * derjohn_mob (~aj@p4FFD26E6.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[19:10] * wwdillingham (~LobsterRo@140.247.242.44) has joined #ceph
[19:12] <rkeene> jdillaman, btw, so far so good on the workaround for #14988 -- thanks so much !
[19:13] <jdillaman> rkeene: good to hear
[19:14] * rdias (~rdias@2001:8a0:749a:d01:c8e2:67f8:472b:c698) has joined #ceph
[19:18] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) has joined #ceph
[19:22] * Miouge (~Miouge@h-72-233.a163.priv.bahnhof.se) has joined #ceph
[19:24] * swami1 (~swami@27.7.161.87) has joined #ceph
[19:25] * nils_ (~nils_@doomstreet.collins.kg) has joined #ceph
[19:25] * MrAbaddon (~MrAbaddon@193.137.26.66) Quit (Ping timeout: 480 seconds)
[19:25] * mykola (~Mikolaj@91.225.200.223) has joined #ceph
[19:25] <LDA> where can I find information that gives --image-feature for the image. layering,stripping...?
[19:26] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[19:29] * rotbeard (~redbeard@2a02:908:df15:1800:6267:20ff:feb7:c20) has joined #ceph
[19:29] * ToMiles (~ToMiles@91.179.71.93) has joined #ceph
[19:30] * tunaaja (~Hejt@93.115.95.207) has joined #ceph
[19:30] * Shnaw (~TGF@4MJAAD3HS.tor-irc.dnsbl.oftc.net) Quit ()
[19:30] * Skaag (~lunix@65.200.54.234) has joined #ceph
[19:33] * Skaag (~lunix@65.200.54.234) Quit ()
[19:34] * ToMiles_ (~ToMiles@91.179.71.93) has joined #ceph
[19:35] * ToMiles (~ToMiles@91.179.71.93) Quit (Quit: leaving)
[19:35] * ToMiles_ (~ToMiles@91.179.71.93) Quit ()
[19:35] * ToMiles (~ToMiles@91.179.71.93) has joined #ceph
[19:36] * thomnico (~thomnico@2a01:e35:8b41:120:b508:f292:5cc9:ba1f) has joined #ceph
[19:39] * Skaag (~lunix@65.200.54.234) has joined #ceph
[19:48] * sugoruyo (~georgev@paarthurnax.esc.rl.ac.uk) Quit (Quit: I'm going home!)
[19:51] * pabluk__ is now known as pabluk_
[19:51] * pabluk_ is now known as pabluk__
[19:53] * krypto (~krypto@sessfw99-sesbfw99-83.ericsson.net) Quit (Ping timeout: 480 seconds)
[20:00] * tunaaja (~Hejt@4MJAAD3IV.tor-irc.dnsbl.oftc.net) Quit ()
[20:00] * toast1 (~Sliker@tor2e1.privacyfoundation.ch) has joined #ceph
[20:03] * thomnico (~thomnico@2a01:e35:8b41:120:b508:f292:5cc9:ba1f) Quit (Ping timeout: 480 seconds)
[20:03] * erwan_taf (~erwan@62.147.161.106) has joined #ceph
[20:04] * evelu (~erwan@37.163.70.251) Quit (Read error: Connection reset by peer)
[20:15] * nils_ (~nils_@doomstreet.collins.kg) Quit (Quit: This computer has gone to sleep)
[20:17] * khyron (~khyron@187.190.152.61) Quit (Quit: The computer fell asleep)
[20:22] * wsirc_8718 (~wsirc_871@www.nisys.be) has joined #ceph
[20:22] * wsirc_8718 is now known as allens
[20:24] * allens (~wsirc_871@www.nisys.be) has left #ceph
[20:24] * srk (~oftc-webi@cpe-70-113-23-93.austin.res.rr.com) has joined #ceph
[20:25] <srk> Hi, anyone tried testing Jewel with new Bluestore?
[20:28] * swami1 (~swami@27.7.161.87) Quit (Ping timeout: 480 seconds)
[20:30] * toast1 (~Sliker@4MJAAD3KA.tor-irc.dnsbl.oftc.net) Quit ()
[20:31] * Miouge (~Miouge@h-72-233.a163.priv.bahnhof.se) Quit (Quit: Miouge)
[20:32] * Miouge (~Miouge@h-72-233.a163.priv.bahnhof.se) has joined #ceph
[20:39] * derjohn_mob (~aj@x590cda2b.dyn.telefonica.de) has joined #ceph
[20:43] * srk (~oftc-webi@cpe-70-113-23-93.austin.res.rr.com) Quit (Quit: Page closed)
[20:51] * treenerd_ (~gsulzberg@cpe90-146-148-47.liwest.at) has joined #ceph
[20:51] * treenerd_ (~gsulzberg@cpe90-146-148-47.liwest.at) Quit ()
[20:53] * valeech (~valeech@pool-108-44-162-111.clppva.fios.verizon.net) has joined #ceph
[20:57] * Miouge (~Miouge@h-72-233.a163.priv.bahnhof.se) Quit (Quit: Miouge)
[20:57] * efirs (~firs@c-50-185-70-125.hsd1.ca.comcast.net) has joined #ceph
[20:59] * valeech (~valeech@pool-108-44-162-111.clppva.fios.verizon.net) Quit (Quit: valeech)
[21:00] * slowriot (~Jyron@atlantic797.serverprofi24.eu) has joined #ceph
[21:01] * TomasCZ (~TomasCZ@yes.tenlab.net) has joined #ceph
[21:05] * ToMiles (~ToMiles@91.179.71.93) Quit (Quit: leaving)
[21:11] * c0dice is now known as codice
[21:12] * nightfuri (~nightfury@182.65.98.203) has joined #ceph
[21:14] * nightfuri (~nightfury@182.65.98.203) has left #ceph
[21:15] <jdillaman> LDA: sorry for the delay
[21:16] <jdillaman> LDA: in Jewel, you can run "rbd help feature disable" or "rbd help create" and it will include all available features
[21:27] * rendar (~I@host127-18-dynamic.13-79-r.retail.telecomitalia.it) Quit (Ping timeout: 480 seconds)
[21:30] * slowriot (~Jyron@4MJAAD3ML.tor-irc.dnsbl.oftc.net) Quit ()
[21:30] * ain (~Sophie@exit1.ipredator.se) has joined #ceph
[21:30] * rendar (~I@host127-18-dynamic.13-79-r.retail.telecomitalia.it) has joined #ceph
[21:32] * Cory1 (77fc11a3@107.161.19.53) Quit (Quit: http://www.kiwiirc.com/ - A hand crafted IRC client)
[21:33] * rendar (~I@host127-18-dynamic.13-79-r.retail.telecomitalia.it) Quit (Read error: Connection reset by peer)
[21:33] * seosepa (~sepa@aperture.GLaDOS.info) Quit (Quit: No Ping reply in 60 seconds.)
[21:33] * neurodrone (~neurodron@158.106.193.162) Quit (Read error: Connection reset by peer)
[21:33] * georgem1 (~Adium@206.108.127.16) has joined #ceph
[21:34] * Cory1 (77fc11a3@107.161.19.53) has joined #ceph
[21:34] * neurodrone (~neurodron@158.106.193.162) has joined #ceph
[21:34] * toastyde1th (~toast@pool-71-255-253-39.washdc.fios.verizon.net) has joined #ceph
[21:35] * seosepa (~sepa@aperture.GLaDOS.info) has joined #ceph
[21:38] * infernix (nix@2001:41f0::2) Quit (Remote host closed the connection)
[21:41] * toastyde2th (~toast@pool-71-255-253-39.washdc.fios.verizon.net) Quit (Ping timeout: 480 seconds)
[21:41] * georgem (~Adium@206.108.127.16) Quit (Ping timeout: 480 seconds)
[21:43] * rendar (~I@host127-18-dynamic.13-79-r.retail.telecomitalia.it) has joined #ceph
[21:44] * efirs (~firs@c-50-185-70-125.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[21:50] * eth00- (~eth00@74.81.187.100) has joined #ceph
[21:51] * Nats_ (~natscogs@114.31.195.238) has joined #ceph
[21:51] * Nats__ (~natscogs@114.31.195.238) Quit (Read error: Connection reset by peer)
[21:51] * eth00 (~eth00@74.81.187.100) Quit (Read error: Connection reset by peer)
[21:57] * remix_auei (~remix_tj@bonatti.remixtj.net) has joined #ceph
[21:58] * sudocat (~dibarra@2602:306:8bc7:4c50:248f:45e4:f8e4:e00c) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * motk (~motk@2600:3c00::f03c:91ff:fe98:51ee) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * joshd (~jdurgin@206.169.83.146) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * Georgyo (~georgyo@2600:3c03:e000:71::cafe:3) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * skullone (~skullone@shell.skull-tech.com) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * diq (~diq@2620:11c:f:2:c23f:d5ff:fe62:112c) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * chutz (~chutz@rygel.linuxfreak.ca) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * remix_tj (~remix_tj@bonatti.remixtj.net) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * skarn (skarn@0001f985.user.oftc.net) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * funnel (~funnel@0001c7d4.user.oftc.net) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * qman (~rohroh@2600:3c00::f03c:91ff:fe69:92af) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * xar (~xar@retard.io) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * Superdawg (~Superdawg@ec2-54-243-59-20.compute-1.amazonaws.com) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * Larsen (~andreas@2001:67c:578:2::15) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * Pintomatic (sid25118@id-25118.ealing.irccloud.com) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * hoonetorg (~hoonetorg@77.119.226.254.static.drei.at) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * pasties (~pasties@00021c52.user.oftc.net) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * atg (~atg@10.127.254.xxx) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * smiley_ (~smiley@205.153.36.170) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * libracious (~libraciou@catchpenny.cf) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * ska (~skatinolo@cpe-173-174-111-177.austin.res.rr.com) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * dec (~dec@71.29.197.104.bc.googleusercontent.com) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * codice (~toodles@75-128-34-237.static.mtpk.ca.charter.com) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * yebyen (~yebyen@129.21.49.95) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * iggy (~iggy@mail.vten.us) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * jmn (~jmn@nat-pool-bos-t.redhat.com) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * Sirenia (~sirenia@454028b1.test.dnsbl.oftc.net) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * jdohms_ (~jdohms@flyingmonkey.concordia.ab.ca) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * wer (~wer@216.197.66.226) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * ffilz (~ffilz@c-76-115-190-27.hsd1.or.comcast.net) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * evilrob (~evilrob@2600:3c00::f03c:91ff:fedf:1d3d) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * mjevans (~mjevans@li984-246.members.linode.com) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * JoeJulian (~JoeJulian@108.166.123.190) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * kingcu (~kingcu@kona.ridewithgps.com) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * scalability-junk (sid6422@id-6422.ealing.irccloud.com) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * ndru (~jawsome@00020819.user.oftc.net) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * harbie (~notroot@2a01:4f8:211:2344:0:dead:beef:1) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * lookcrabs (~lookcrabs@tail.seeee.us) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * wateringcan (~mattt@lnx1.defunct.ca) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * rkeene (1011@oc9.org) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * logan- (~logan@2607:ff68:100:36::29d) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * mischief (~mischief@iota.offblast.org) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * med (~medberry@71.74.177.250) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * scuttle|afk (~scuttle@nat-pool-rdu-t.redhat.com) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * theanalyst (theanalyst@open.source.rocks.my.socks.firrre.com) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * aiicore (~aiicore@s30.linuxpl.com) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * marco208 (~root@159.253.7.204) Quit (resistance.oftc.net charm.oftc.net)
[21:58] * lookcrabs (~lookcrabs@tail.seeee.us) has joined #ceph
[21:58] * yebyen (~yebyen@martyfunkhouser.csh.rit.edu) has joined #ceph
[21:58] * iggy (~iggy@mail.vten.us) has joined #ceph
[21:58] * ndru (~jawsome@104.236.94.35) has joined #ceph
[21:58] * codice (~toodles@75-128-34-237.static.mtpk.ca.charter.com) has joined #ceph
[21:58] * funnel (~funnel@0001c7d4.user.oftc.net) has joined #ceph
[21:58] * wateringcan (~mattt@lnx1.defunct.ca) has joined #ceph
[21:59] * marco208 (~root@159.253.7.204) has joined #ceph
[21:59] * aiicore (~aiicore@s30.linuxpl.com) has joined #ceph
[21:59] * mischief (~mischief@iota.offblast.org) has joined #ceph
[21:59] * jdohms (~jdohms@flyingmonkey.concordia.ab.ca) has joined #ceph
[22:00] * ain (~Sophie@6AGAAAMEI.tor-irc.dnsbl.oftc.net) Quit ()
[22:00] * Silentspy (~HoboPickl@06SAAA35H.tor-irc.dnsbl.oftc.net) has joined #ceph
[22:00] * SpamapS (~SpamapS@xencbyrum2.srihosting.com) Quit (Ping timeout: 480 seconds)
[22:01] * JoeJulian (~JoeJulian@108.166.123.190) has joined #ceph
[22:01] * Sirenia (~sirenia@454028b1.test.dnsbl.oftc.net) has joined #ceph
[22:02] * scuttle|afk (~scuttle@nat-pool-rdu-t.redhat.com) has joined #ceph
[22:02] * med (~medberry@71.74.177.250) has joined #ceph
[22:02] * bniver (~bniver@71-9-144-29.static.oxfr.ma.charter.com) Quit (Remote host closed the connection)
[22:02] * linjan_ (~linjan@176.195.217.66) has joined #ceph
[22:03] * kingcu (~kingcu@kona.ridewithgps.com) has joined #ceph
[22:03] * ska (~skatinolo@cpe-173-174-111-177.austin.res.rr.com) has joined #ceph
[22:04] * jmn (~jmn@nat-pool-bos-t.redhat.com) has joined #ceph
[22:04] * skarn (skarn@0001f985.user.oftc.net) has joined #ceph
[22:04] * smiley_ (~smiley@205.153.36.170) has joined #ceph
[22:04] * ffilz (~ffilz@c-76-115-190-27.hsd1.or.comcast.net) has joined #ceph
[22:05] * joshd (~jdurgin@206.169.83.146) has joined #ceph
[22:06] * SpamapS (~SpamapS@xencbyrum2.srihosting.com) has joined #ceph
[22:06] * sudocat (~dibarra@2602:306:8bc7:4c50:248f:45e4:f8e4:e00c) has joined #ceph
[22:06] * motk (~motk@2600:3c00::f03c:91ff:fe98:51ee) has joined #ceph
[22:06] * Georgyo (~georgyo@2600:3c03:e000:71::cafe:3) has joined #ceph
[22:06] * diq (~diq@2620:11c:f:2:c23f:d5ff:fe62:112c) has joined #ceph
[22:06] * chutz (~chutz@rygel.linuxfreak.ca) has joined #ceph
[22:06] * qman (~rohroh@2600:3c00::f03c:91ff:fe69:92af) has joined #ceph
[22:06] * xar (~xar@retard.io) has joined #ceph
[22:06] * Superdawg (~Superdawg@ec2-54-243-59-20.compute-1.amazonaws.com) has joined #ceph
[22:06] * Larsen (~andreas@2001:67c:578:2::15) has joined #ceph
[22:06] * Pintomatic (sid25118@id-25118.ealing.irccloud.com) has joined #ceph
[22:06] * pasties (~pasties@00021c52.user.oftc.net) has joined #ceph
[22:06] * dec (~dec@71.29.197.104.bc.googleusercontent.com) has joined #ceph
[22:06] * evilrob (~evilrob@2600:3c00::f03c:91ff:fedf:1d3d) has joined #ceph
[22:06] * logan- (~logan@2607:ff68:100:36::29d) has joined #ceph
[22:06] * harbie (~notroot@2a01:4f8:211:2344:0:dead:beef:1) has joined #ceph
[22:06] * theanalyst (theanalyst@open.source.rocks.my.socks.firrre.com) has joined #ceph
[22:06] * scalability-junk (sid6422@id-6422.ealing.irccloud.com) has joined #ceph
[22:06] * rkeene (1011@oc9.org) has joined #ceph
[22:06] * mjevans (~mjevans@li984-246.members.linode.com) has joined #ceph
[22:08] * atg (~atg@10.127.254.xxx) has joined #ceph
[22:10] * skullone (~skullone@shell.skull-tech.com) has joined #ceph
[22:11] * hoonetorg (~hoonetorg@77.119.226.254.static.drei.at) has joined #ceph
[22:11] * wer (~wer@216.197.66.226) has joined #ceph
[22:13] * MrAbaddon (~MrAbaddon@a89-155-99-93.cpe.netcabo.pt) has joined #ceph
[22:18] * infernix (nix@spirit.infernix.net) has joined #ceph
[22:25] * georgem1 (~Adium@206.108.127.16) Quit (Ping timeout: 480 seconds)
[22:30] * Silentspy (~HoboPickl@06SAAA35H.tor-irc.dnsbl.oftc.net) Quit ()
[22:30] * pepzi1 (~Rosenblut@06SAAA38L.tor-irc.dnsbl.oftc.net) has joined #ceph
[22:31] * mykola (~Mikolaj@91.225.200.223) Quit (Quit: away)
[22:32] * wjw-freebsd (~wjw@smtp.digiware.nl) has joined #ceph
[22:38] * linjan_ (~linjan@176.195.217.66) Quit (Ping timeout: 480 seconds)
[22:41] * infernix (nix@spirit.infernix.net) Quit (Ping timeout: 480 seconds)
[22:41] * togdon (~togdon@74.121.28.6) has joined #ceph
[22:43] * infernix (~nix@spirit.infernix.net) has joined #ceph
[22:47] * shaunm (~shaunm@cpe-192-180-18-62.kya.res.rr.com) Quit (Ping timeout: 480 seconds)
[22:47] * linjan_ (~linjan@176.195.217.66) has joined #ceph
[22:51] * infernix (~nix@spirit.infernix.net) Quit (Quit: ZNC - http://znc.sourceforge.net)
[22:54] * khyron (~khyron@200.77.224.239) has joined #ceph
[22:55] * infernix (nix@2001:41f0::2) has joined #ceph
[22:55] * georgem (~Adium@24.114.70.221) has joined #ceph
[22:57] * bjornar__ (~bjornar@ti0099a430-1561.bb.online.no) Quit (Ping timeout: 480 seconds)
[22:58] * LDA (~lda@host217-114-156-249.pppoe.mark-itt.net) Quit (Quit: LDA)
[22:59] * georgem (~Adium@24.114.70.221) has left #ceph
[23:00] * pepzi1 (~Rosenblut@06SAAA38L.tor-irc.dnsbl.oftc.net) Quit ()
[23:00] * vbellur (~vijay@71.234.224.255) has joined #ceph
[23:00] * Enikma (~Deiz@destiny.enn.lu) has joined #ceph
[23:01] * rotbeard (~redbeard@2a02:908:df15:1800:6267:20ff:feb7:c20) Quit (Quit: Leaving)
[23:07] * wwdillingham (~LobsterRo@140.247.242.44) Quit (Ping timeout: 480 seconds)
[23:08] * brad_mssw (~brad@66.129.88.50) Quit (Quit: Leaving)
[23:17] * mhack (~mhack@nat-pool-bos-t.redhat.com) Quit (Remote host closed the connection)
[23:23] * erwan_taf (~erwan@62.147.161.106) Quit (Ping timeout: 480 seconds)
[23:29] * haplo37 (~haplo37@24-50-67-141.ri.cgocable.ca) Quit (Ping timeout: 480 seconds)
[23:30] * Enikma (~Deiz@76GAAD8YK.tor-irc.dnsbl.oftc.net) Quit ()
[23:32] * rendar (~I@host127-18-dynamic.13-79-r.retail.telecomitalia.it) Quit (Quit: std::lower_bound + std::less_equal *works* with a vector without duplicates!)
[23:38] * shaunm (~shaunm@74.83.215.100) has joined #ceph
[23:41] * cathode (~cathode@50.232.215.114) has joined #ceph

These logs were automatically created by CephLogBot on irc.oftc.net using the Java IRC LogBot.