#ceph IRC Log

Index

IRC Log for 2016-05-27

Timestamps are in GMT/BST.

[0:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[0:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[0:07] * protot (~perry@b2b-78-94-59-114.unitymedia.biz) has joined #ceph
[0:08] <protot> anyone have any insight as to why my freebsd machines are getting about 1/3 or 1/4 the read and write speed to cephfs compared to my debian vms?
[0:12] * roaet (~pico@torland1-this.is.a.tor.exit.server.torland.is) has joined #ceph
[0:15] * bniver (~bniver@71-9-144-29.static.oxfr.ma.charter.com) Quit (Remote host closed the connection)
[0:20] * lmb (~Lars@2a02:8109:8100:1d2c:2ad2:44ff:fedf:3318) Quit (Ping timeout: 480 seconds)
[0:21] <infernix> does the Wireshark ceph dissector not support osd<>osd traffic?
[0:21] <infernix> i see client to osd and osd to client but no osd to osd, plus lots of not-parsed streams
[0:22] * madkiss (~madkiss@ip5b414c62.dynamic.kabel-deutschland.de) Quit (Quit: Leaving.)
[0:24] <flaf> infernix: do you use public/cluster networks?
[0:25] <infernix> yeah i believe it's split traffic
[0:26] <infernix> but there's a dump for all ports on which an OSD claims to be listening
[0:26] <infernix> so it should show up
[0:27] <flaf> Because, not sure, but I think osd<->osd traffic is in the cluster network, so maybe you don't inspect the good interface?
[0:28] <infernix> it's in 2 vlans on the same nic
[0:28] <infernix> so ethX.100 and ethX.101
[0:28] <infernix> tcpdump on ethX should capture both, no?
[0:28] <flaf> Ah ok. So my explanation is bad.
[0:28] <flaf> Yes.
[0:29] <flaf> infernix: all is up with ???ceph osd tree????
[0:30] * lmb (~Lars@ip5b41f0a4.dynamic.kabel-deutschland.de) has joined #ceph
[0:32] <infernix> yeah this is a very low level problem
[0:32] <infernix> a message just over 8Mb never gets received by the msg reader from osd A to B
[0:32] <infernix> everything under is fine
[0:32] <flaf> infernix: sorry, I have no idea.
[0:34] <infernix> me neither, at least not yet :)
[0:34] <flaf> infernix: the only thing I can tell you is in my cluster with a tcpdump of the NIC dedicated to the "cluster" network, I see traffic osd<->osd.
[0:35] <flaf> even if the cluster is relatively idle now.
[0:38] <protot> anyone have any insight as to why my freebsd vms are getting about 1/3 or 1/4 the read and write speed to cephfs compared to my debian vms?
[0:39] <infernix> flaf: with these filters: ceph.dst.type == 0x04 && ceph.src.type == 0x04
[0:40] <infernix> in wireshark that is, i don't see anything
[0:41] <infernix> meaning i see the packets but the ceph dissector doesn't seem to decode it at all
[0:42] * roaet (~pico@4MJAAFLB5.tor-irc.dnsbl.oftc.net) Quit ()
[0:42] * demonspork (~Dragonsha@06SAAC2V5.tor-irc.dnsbl.oftc.net) has joined #ceph
[0:42] <infernix> so it filters everything out
[0:42] <infernix> i definitely see packets from osd to osd if i filter on dst_host for example
[0:46] * Blfrg (~Blfrg@186.4.22.14) has joined #ceph
[0:47] * stiopa (~stiopa@cpc73832-dals21-2-0-cust453.20-2.cable.virginm.net) Quit (Ping timeout: 480 seconds)
[0:48] * debian112 (~bcolbert@24.126.201.64) Quit (Read error: Connection reset by peer)
[0:49] * yanzheng2 (~zhyan@118.116.115.252) has joined #ceph
[0:49] * vata (~vata@207.96.182.162) Quit (Quit: Leaving.)
[0:50] * yanzheng1 (~zhyan@118.116.115.252) Quit (Ping timeout: 480 seconds)
[0:58] * linuxkidd (~linuxkidd@nv-184-0-110-250.dhcp.embarqhsd.net) Quit (Ping timeout: 480 seconds)
[0:59] * rjdias (~rdias@2001:8a0:749a:d01:4d3e:14b9:21c2:f076) has joined #ceph
[1:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[1:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[1:03] * rdias (~rdias@bl7-92-98.dsl.telepac.pt) Quit (Ping timeout: 480 seconds)
[1:03] * rjdias is now known as rdias
[1:08] <TheSov> why dont air conditioner condensor coils have water spraying on them?
[1:10] * linjan__ (~linjan@176.195.235.8) has joined #ceph
[1:10] * ntpttr_laptop (~ntpttr@134.134.139.83) Quit (Remote host closed the connection)
[1:11] * debian112 (~bcolbert@24.126.201.64) has joined #ceph
[1:12] * demonspork (~Dragonsha@06SAAC2V5.tor-irc.dnsbl.oftc.net) Quit ()
[1:12] * hifi1 (~Hejt@ns316491.ip-37-187-129.eu) has joined #ceph
[1:14] * vasu (~vasu@c-73-231-60-138.hsd1.ca.comcast.net) Quit (Quit: Leaving)
[1:16] * yanzheng1 (~zhyan@118.116.112.223) has joined #ceph
[1:16] * linuxkidd (~linuxkidd@ip70-189-207-54.lv.lv.cox.net) has joined #ceph
[1:18] * yanzheng2 (~zhyan@118.116.115.252) Quit (Ping timeout: 480 seconds)
[1:23] * nils_ (~nils_@doomstreet.collins.kg) Quit (Quit: This computer has gone to sleep)
[1:30] * oms101 (~oms101@p20030057EA004100C6D987FFFE4339A1.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[1:33] * rendar (~I@host146-177-dynamic.20-87-r.retail.telecomitalia.it) Quit (Quit: std::lower_bound + std::less_equal *works* with a vector without duplicates!)
[1:37] * sudocat (~dibarra@192.185.1.20) Quit (Ping timeout: 480 seconds)
[1:37] * lcurtis_ (~lcurtis@47.19.105.250) Quit (Ping timeout: 480 seconds)
[1:38] * oms101 (~oms101@p20030057EA012D00C6D987FFFE4339A1.dip0.t-ipconnect.de) has joined #ceph
[1:42] * hifi1 (~Hejt@06SAAC2XO.tor-irc.dnsbl.oftc.net) Quit ()
[1:42] * Defaultti1 (~mollstam@91.250.241.241) has joined #ceph
[1:56] * rwmjones (~rwmjones@230.83.187.81.in-addr.arpa) Quit (Ping timeout: 480 seconds)
[2:00] * rwmjones (~rwmjones@230.83.187.81.in-addr.arpa) has joined #ceph
[2:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[2:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[2:01] * nils_ (~nils_@doomstreet.collins.kg) has joined #ceph
[2:03] * xarses (~xarses@64.124.158.100) Quit (Ping timeout: 480 seconds)
[2:09] * brians__ (~brian@80.111.114.175) has joined #ceph
[2:09] * nils_____ (~nils_@doomstreet.collins.kg) has joined #ceph
[2:10] * MentalRay (~MentalRay@MTRLPQ42-1176054809.sdsl.bell.ca) Quit (Ping timeout: 480 seconds)
[2:10] * Skaag (~lunix@65.200.54.234) Quit (Quit: Leaving.)
[2:10] * nils_____ (~nils_@doomstreet.collins.kg) Quit ()
[2:12] * Defaultti1 (~mollstam@4MJAAFLFS.tor-irc.dnsbl.oftc.net) Quit ()
[2:12] * nils_____ (~nils_@doomstreet.collins.kg) has joined #ceph
[2:13] * WhiteBxEng (~whitebxen@ip72-208-208-76.ph.ph.cox.net) Quit (Remote host closed the connection)
[2:14] * nils_ (~nils_@doomstreet.collins.kg) Quit (Ping timeout: 480 seconds)
[2:15] * LeaChim (~LeaChim@host86-176-96-249.range86-176.btcentralplus.com) Quit (Ping timeout: 480 seconds)
[2:15] * brians (~brian@80.111.114.175) Quit (Ping timeout: 480 seconds)
[2:16] * linjan__ (~linjan@176.195.235.8) Quit (Ping timeout: 480 seconds)
[2:22] * xarses (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) has joined #ceph
[2:28] * onyb (~ani07nov@112.133.232.10) Quit (Quit: raise SystemExit())
[2:33] * WhiteBxEng (~whitebxen@ip72-208-208-76.ph.ph.cox.net) has joined #ceph
[2:40] * huangjun (~kvirc@113.57.168.154) has joined #ceph
[2:44] * protot (~perry@b2b-78-94-59-114.unitymedia.biz) Quit (Ping timeout: 480 seconds)
[2:44] <ronrib> any word on cephfs root squash?
[2:53] <ronrib> i'm playing with cephfs, it looks like the cluster loses contact with OSDs for just a moment under heavy load (OSDs go down and back up after about 2 or 3 seconds) could this be a switch / dropped packet issue?
[2:56] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[3:01] * todin (tuxadero@kudu.in-berlin.de) Quit (Remote host closed the connection)
[3:05] * WhiteBxEng (~whitebxen@ip72-208-208-76.ph.ph.cox.net) Quit (Remote host closed the connection)
[3:12] * brannmar (~SweetGirl@nl11x.mullvad.net) has joined #ceph
[3:12] * MentalRay (~MentalRay@107.171.161.165) has joined #ceph
[3:34] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[3:41] * EinstCrazy (~EinstCraz@58.247.119.250) has joined #ceph
[3:42] * brannmar (~SweetGirl@4MJAAFLIM.tor-irc.dnsbl.oftc.net) Quit ()
[3:45] * newdave (~newdave@36-209-181-180.cpe.skymesh.net.au) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[3:49] * DV (~veillard@2001:41d0:a:f29f::1) Quit (Remote host closed the connection)
[3:49] * wushudoin (~wushudoin@2601:646:9501:d2b2:2ab2:bdff:fe0b:a6ee) Quit (Ping timeout: 480 seconds)
[3:49] * shyu (~shyu@123.112.100.186) has joined #ceph
[3:54] * zhaochao (~zhaochao@125.39.112.4) has joined #ceph
[3:58] * i_m (~ivan.miro@nat-5-carp.hcn-strela.ru) Quit (Quit: Leaving.)
[4:00] * mhuang (~mhuang@119.254.120.72) has joined #ceph
[4:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[4:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[4:04] * newdave (~newdave@36-209-181-180.cpe.skymesh.net.au) has joined #ceph
[4:07] * Racpatel (~Racpatel@2601:87:3:3601::4edb) Quit (Quit: Leaving)
[4:07] * shyu (~shyu@123.112.100.186) Quit (Ping timeout: 480 seconds)
[4:19] * newdave (~newdave@36-209-181-180.cpe.skymesh.net.au) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[4:20] * vicente (~~vicente@125-227-238-55.HINET-IP.hinet.net) has joined #ceph
[4:23] * newdave (~newdave@36-209-181-180.cpe.skymesh.net.au) has joined #ceph
[4:23] * ntpttr_laptop (~ntpttr@134.134.139.77) has joined #ceph
[4:26] * newdave (~newdave@36-209-181-180.cpe.skymesh.net.au) Quit ()
[4:29] * yanzheng2 (~zhyan@118.116.112.223) has joined #ceph
[4:31] * yanzheng1 (~zhyan@118.116.112.223) Quit (Ping timeout: 480 seconds)
[4:33] * wjw-freebsd (~wjw@smtp.digiware.nl) Quit (Ping timeout: 480 seconds)
[4:34] * xar (~xar@retard.io) Quit (Ping timeout: 480 seconds)
[4:34] * xar (~xar@retard.io) has joined #ceph
[4:42] * Moriarty (~Solvius@06SAAC253.tor-irc.dnsbl.oftc.net) has joined #ceph
[4:46] * mhuang_ (~mhuang@119.254.120.71) has joined #ceph
[4:50] * mhuang (~mhuang@119.254.120.72) Quit (Ping timeout: 480 seconds)
[4:55] * kefu (~kefu@114.92.122.74) has joined #ceph
[4:59] * flisky (~Thunderbi@36.110.40.22) has joined #ceph
[5:00] * ntpttr_laptop (~ntpttr@134.134.139.77) Quit (Ping timeout: 480 seconds)
[5:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[5:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[5:12] * Moriarty (~Solvius@06SAAC253.tor-irc.dnsbl.oftc.net) Quit ()
[5:12] * Throlkim (~AGaW@176.116.104.49) has joined #ceph
[5:13] * Vacuum_ (~Vacuum@88.130.215.138) has joined #ceph
[5:14] * Nats_ (~natscogs@114.31.195.238) has joined #ceph
[5:19] * ira (~ira@c-24-34-255-34.hsd1.ma.comcast.net) Quit (Ping timeout: 480 seconds)
[5:21] * Vacuum__ (~Vacuum@i59F79B3A.versanet.de) Quit (Ping timeout: 480 seconds)
[5:22] * Nats (~natscogs@114.31.195.238) Quit (Ping timeout: 480 seconds)
[5:24] * debian112 (~bcolbert@24.126.201.64) Quit (Ping timeout: 480 seconds)
[5:25] * mhuang_ (~mhuang@119.254.120.71) Quit (Read error: Connection reset by peer)
[5:37] * nils_____ (~nils_@doomstreet.collins.kg) Quit (Ping timeout: 480 seconds)
[5:37] * nils_ (~nils_@doomstreet.collins.kg) has joined #ceph
[5:37] <ronrib> looks like it's a ulimit (open files) issue, is there a nice list of environment variables I should set for ceph running on ubuntu 14.04?
[5:42] * Throlkim (~AGaW@7V7AAFA3U.tor-irc.dnsbl.oftc.net) Quit ()
[5:44] <nils_> ronrib, It's important to realise that the open file limit is not really an environment variable, more of an OS safeguard
[5:47] <ronrib> humm i see
[5:47] <ronrib> just found the osd process should set it itself too
[5:48] <ronrib> might have to start digging through some source :D common/Thread.cc: 160: FAILED assert(ret == 0)
[5:55] <ronrib> looks like that was it
[5:55] <ronrib> nano /etc/security/limits.conf
[5:55] <ronrib> root soft nofile 65535
[5:55] <ronrib> root hard nofile 65535
[5:55] <ronrib> reboot all the nodes, no more flapping OSDs
[5:56] * madkiss (~madkiss@ip5b414c62.dynamic.kabel-deutschland.de) has joined #ceph
[5:56] <lurbs> nano? You're sick.
[5:56] <lurbs> :D
[5:57] * madkiss (~madkiss@ip5b414c62.dynamic.kabel-deutschland.de) Quit (Read error: No route to host)
[5:58] <ronrib> haha
[6:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[6:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[6:08] <nils_> ronrib, I don't think that's it.
[6:09] <nils_> ronrib, are you on systemd, upstart or sysvinit?
[6:11] * kefu (~kefu@114.92.122.74) Quit (Max SendQ exceeded)
[6:12] * Morde (~richardus@193-238-47-212.rev.cloud.scaleway.com) has joined #ceph
[6:12] * kefu (~kefu@116.251.213.236) has joined #ceph
[6:14] * deepthi (~deepthi@27.56.150.171) has joined #ceph
[6:18] * MentalRay (~MentalRay@107.171.161.165) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[6:24] <ronrib> it's the only thing I changed before the reboot :V ubuntu 14.04 so upstart
[6:25] <ronrib> before it would fall over within a minute, now I've had a solid ~700MB/s stream writing for the last 20 minutes
[6:28] <ronrib> nils_: what were you thinking?
[6:29] <ronrib> I was inspired by looking through past tracker issues
[6:29] <ronrib> but i'm always interested in finding the root cause
[6:30] * jermudgeon (~jhaustin@southend.mdu.whitestone.link) has joined #ceph
[6:31] * jermudgeon (~jhaustin@southend.mdu.whitestone.link) Quit ()
[6:32] * efirs (~firs@c-50-185-70-125.hsd1.ca.comcast.net) has joined #ceph
[6:42] * Morde (~richardus@7V7AAFA5W.tor-irc.dnsbl.oftc.net) Quit ()
[6:42] * osuka_ (~SinZ|offl@freedom.ip-eend.nl) has joined #ceph
[6:46] * rdas (~rdas@106.221.141.29) has joined #ceph
[6:46] * jermudgeon (~jhaustin@southend.mdu.whitestone.link) has joined #ceph
[6:54] <ronrib> and then i apparently hit the pid_max limit
[7:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[7:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[7:07] * TomasCZ (~TomasCZ@yes.tenlab.net) Quit (Quit: Leaving)
[7:08] * vikhyat (~vumrao@123.252.148.25) has joined #ceph
[7:12] * osuka_ (~SinZ|offl@06SAAC3AB.tor-irc.dnsbl.oftc.net) Quit ()
[7:14] * nils_ (~nils_@doomstreet.collins.kg) Quit (Quit: This computer has gone to sleep)
[7:15] * bvi (~Bastiaan@185.56.32.1) has joined #ceph
[7:16] * drupal (~verbalins@tor-exit1-readme.dfri.se) has joined #ceph
[7:21] * mhuang (~mhuang@119.254.120.72) has joined #ceph
[7:25] * sage (~quassel@2607:f298:6050:709d:75cc:9006:dbc1:632) Quit (Remote host closed the connection)
[7:26] * sage (~quassel@2607:f298:6050:709d:d1c8:d5cf:6390:78a6) has joined #ceph
[7:26] * ChanServ sets mode +o sage
[7:33] * rakeshgm (~rakesh@106.51.29.57) has joined #ceph
[7:35] * krypto (~krypto@G68-90-105-225.sbcis.sbc.com) has joined #ceph
[7:46] * drupal (~verbalins@4MJAAFLQ8.tor-irc.dnsbl.oftc.net) Quit ()
[7:47] * Kalado (~Knuckx@exit1.ipredator.se) has joined #ceph
[7:50] * derjohn_mob (~aj@x590c68fa.dyn.telefonica.de) has joined #ceph
[7:53] * ieth0 (~ieth0@user232.77-105-223.netatonce.net) has joined #ceph
[7:56] * overclk (~quassel@121.244.87.117) has joined #ceph
[7:57] * derjohn_mob (~aj@x590c68fa.dyn.telefonica.de) Quit (Remote host closed the connection)
[7:59] * vikhyat (~vumrao@123.252.148.25) Quit (Quit: Leaving)
[8:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[8:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[8:01] * debian112 (~bcolbert@24.126.201.64) has joined #ceph
[8:03] * vikhyat (~vumrao@123.252.148.25) has joined #ceph
[8:03] * stiopa (~stiopa@cpc73832-dals21-2-0-cust453.20-2.cable.virginm.net) has joined #ceph
[8:12] * stiopa (~stiopa@cpc73832-dals21-2-0-cust453.20-2.cable.virginm.net) Quit (Ping timeout: 480 seconds)
[8:13] * ade (~abradshaw@dslb-188-103-020-040.188.103.pools.vodafone-ip.de) has joined #ceph
[8:16] * Kalado (~Knuckx@7V7AAFA9L.tor-irc.dnsbl.oftc.net) Quit ()
[8:16] * eXeler0n (~Harryhy@163.172.152.231) has joined #ceph
[8:28] * ieth0 (~ieth0@user232.77-105-223.netatonce.net) Quit (Quit: ieth0)
[8:33] * epicguy (~epicguy@41.164.8.42) has joined #ceph
[8:37] * flisky (~Thunderbi@246e2816.test.dnsbl.oftc.net) Quit (Read error: Connection reset by peer)
[8:39] * karnan (~karnan@121.244.87.117) has joined #ceph
[8:41] * kawa2014 (~kawa@212.110.41.244) has joined #ceph
[8:41] * flisky (~Thunderbi@36.110.40.22) has joined #ceph
[8:43] * Skaag (~lunix@cpe-172-91-77-84.socal.res.rr.com) has joined #ceph
[8:46] * eXeler0n (~Harryhy@7V7AAFBAR.tor-irc.dnsbl.oftc.net) Quit ()
[8:46] * dugravot6 (~dugravot6@nat-persul-plg.wifi.univ-lorraine.fr) has joined #ceph
[8:46] * SinZ|offline (~Corneliou@marylou.nos-oignons.net) has joined #ceph
[8:48] * flisky (~Thunderbi@246e2816.test.dnsbl.oftc.net) Quit (Quit: flisky)
[8:58] * kefu_ (~kefu@114.92.122.74) has joined #ceph
[8:59] * bara (~bara@ip4-83-240-10-82.cust.nbox.cz) has joined #ceph
[9:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[9:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[9:03] * kefu (~kefu@116.251.213.236) Quit (Ping timeout: 480 seconds)
[9:06] * analbeard (~shw@support.memset.com) has joined #ceph
[9:10] * Hemanth (~hkumar_@121.244.87.117) has joined #ceph
[9:12] * lxo (~aoliva@lxo.user.oftc.net) Quit (Ping timeout: 480 seconds)
[9:13] * frickler (~jens@v1.jayr.de) Quit (Ping timeout: 480 seconds)
[9:16] * SinZ|offline (~Corneliou@4MJAAFLT0.tor-irc.dnsbl.oftc.net) Quit ()
[9:16] * Tumm2 (~bret@edwardsnowden2.torservers.net) has joined #ceph
[9:20] * allaok (~allaok@machine107.orange-labs.com) has joined #ceph
[9:20] * joshd1 (~jdurgin@71-92-201-212.dhcp.gldl.ca.charter.com) has joined #ceph
[9:21] * wjw-freebsd (~wjw@smtp.digiware.nl) has joined #ceph
[9:29] * todin (tuxadero@kudu.in-berlin.de) has joined #ceph
[9:30] * frickler (~jens@v1.jayr.de) has joined #ceph
[9:39] * evelu (~erwan@37.160.216.122) has joined #ceph
[9:44] * linjan (~linjan@86.62.112.22) has joined #ceph
[9:46] * Tumm2 (~bret@06SAAC3F6.tor-irc.dnsbl.oftc.net) Quit ()
[9:46] * Linkshot (~Hideous@7V7AAFBEF.tor-irc.dnsbl.oftc.net) has joined #ceph
[9:50] * kmroz (~kilo@00020103.user.oftc.net) Quit (Quit: brb)
[9:57] * allaok (~allaok@machine107.orange-labs.com) Quit (Quit: Leaving.)
[9:57] * allaok (~allaok@machine107.orange-labs.com) has joined #ceph
[10:00] * T1w (~jens@node3.survey-it.dk) has joined #ceph
[10:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[10:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[10:01] * rendar (~I@host213-59-dynamic.22-79-r.retail.telecomitalia.it) has joined #ceph
[10:07] * TMM (~hp@178-84-46-106.dynamic.upc.nl) Quit (Quit: Ex-Chat)
[10:08] * derjohn_mob (~aj@88.128.80.178) has joined #ceph
[10:13] * jordanP (~jordan@204.13-14-84.ripe.coltfrance.com) has joined #ceph
[10:16] * Linkshot (~Hideous@7V7AAFBEF.tor-irc.dnsbl.oftc.net) Quit ()
[10:16] * theghost99 (~TehZomB@46.17.100.14) has joined #ceph
[10:19] * owasserm (~owasserm@2001:984:d3f7:1:5ec5:d4ff:fee0:f6dc) has joined #ceph
[10:25] * derjohn_mob (~aj@88.128.80.178) Quit (Remote host closed the connection)
[10:26] * prallab (~prallab@106.51.130.58) has joined #ceph
[10:28] * jermudgeon (~jhaustin@southend.mdu.whitestone.link) Quit (Quit: jermudgeon)
[10:28] * efirs (~firs@c-50-185-70-125.hsd1.ca.comcast.net) Quit (Quit: Leaving.)
[10:34] * prallab (~prallab@106.51.130.58) Quit (Ping timeout: 480 seconds)
[10:38] * rdias (~rdias@2001:8a0:749a:d01:4d3e:14b9:21c2:f076) Quit (Ping timeout: 480 seconds)
[10:38] * LeaChim (~LeaChim@host86-176-96-249.range86-176.btcentralplus.com) has joined #ceph
[10:38] * mhuang (~mhuang@119.254.120.72) Quit (Ping timeout: 480 seconds)
[10:39] * karnan (~karnan@121.244.87.117) Quit (Ping timeout: 480 seconds)
[10:41] * badone (~badone@66.187.239.16) has joined #ceph
[10:41] * rdias (~rdias@2001:8a0:749a:d01:4d3e:14b9:21c2:f076) has joined #ceph
[10:44] * Miouge (~Miouge@188.189.70.220) has joined #ceph
[10:46] * krypto (~krypto@G68-90-105-225.sbcis.sbc.com) Quit (Read error: Connection reset by peer)
[10:46] * shyu (~shyu@58.200.129.137) has joined #ceph
[10:46] * theghost99 (~TehZomB@7V7AAFBFN.tor-irc.dnsbl.oftc.net) Quit ()
[10:46] * Hideous (~Redshift@06SAAC3KH.tor-irc.dnsbl.oftc.net) has joined #ceph
[10:46] <Miouge> A pool with ???size = 3 and min_size = 2??? does 2 synchronous writes, then ACKs the client, and the 3rd write is done asynchroniously?
[10:48] * allaok (~allaok@machine107.orange-labs.com) Quit (Quit: Leaving.)
[10:49] * karnan (~karnan@121.244.87.117) has joined #ceph
[10:49] * ngoswami (~ngoswami@1.39.96.26) has joined #ceph
[10:49] * TMM (~hp@185.5.121.201) has joined #ceph
[10:50] * frank (~Frank@149.210.210.150) Quit (Ping timeout: 480 seconds)
[10:50] * Skaag (~lunix@cpe-172-91-77-84.socal.res.rr.com) Quit (Quit: Leaving.)
[10:51] * frank (~Frank@149.210.210.150) has joined #ceph
[10:52] * wjw-freebsd (~wjw@smtp.digiware.nl) Quit (Ping timeout: 480 seconds)
[10:53] * MrAbaddon (~MrAbaddon@a89-155-99-93.cpe.netcabo.pt) Quit (Remote host closed the connection)
[10:53] * prallab (~prallab@106.51.129.244) has joined #ceph
[10:58] <IcePic> I think min_size is not about the ACKs but rather at which point it will go ReadOnly in order to prevent writes to PGs where you dont have good enough redundancy according to that policy.
[10:59] <IcePic> it will ack when 3 writes are complete (as in has-hit-the-journal) on all 3 destinations
[10:59] <IcePic> http://docs.ceph.com/docs/jewel/rados/operations/pools/#set-the-number-of-object-replicas
[11:00] * zhaochao_ (~zhaochao@124.202.191.132) has joined #ceph
[11:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[11:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[11:01] * prallab (~prallab@106.51.129.244) Quit (Ping timeout: 480 seconds)
[11:05] * zhaochao (~zhaochao@125.39.112.4) Quit (Ping timeout: 480 seconds)
[11:05] * zhaochao_ is now known as zhaochao
[11:10] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:54a7:ee68:f92e:8733) has joined #ceph
[11:11] * dgurtner (~dgurtner@178.197.225.26) has joined #ceph
[11:14] * i_m (~ivan.miro@nat-5-carp.hcn-strela.ru) has joined #ceph
[11:14] * karnan (~karnan@121.244.87.117) Quit (Ping timeout: 480 seconds)
[11:14] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:54a7:ee68:f92e:8733) Quit (Read error: Connection reset by peer)
[11:16] * Hideous (~Redshift@06SAAC3KH.tor-irc.dnsbl.oftc.net) Quit ()
[11:16] <Miouge> IcePic: Oh ok. So min_size applies only to degraded mode, then when the broken OSDs come back online it backfills
[11:17] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:bdec:41f7:40ac:73c4) has joined #ceph
[11:19] * tserong (~tserong@203-214-92-220.dyn.iinet.net.au) has joined #ceph
[11:20] * Miouge (~Miouge@188.189.70.220) Quit (Quit: Miouge)
[11:21] * Miouge (~Miouge@188.189.70.220) has joined #ceph
[11:22] <TMM> If I have multiple different classes of disks in my physical osd machines, I need to add those disks to a separate crush bucket, right?
[11:22] <TMM> but where do I place that bucket in the hierarchy?
[11:23] <TMM> I've used 'pick' directives in crush before to confine certain pools to certain racks
[11:23] <TMM> but this bucket would sit below 'host' right?
[11:24] * shyu (~shyu@58.200.129.137) Quit (Ping timeout: 480 seconds)
[11:24] <TMM> we have root/region/dc/room/pod/pdu/row/rack/chassis/host/osd, right? Would I need something between host and osd?
[11:24] * karnan (~karnan@121.244.87.117) has joined #ceph
[11:25] * Skaag (~lunix@cpe-172-91-77-84.socal.res.rr.com) has joined #ceph
[11:26] <Miouge> TMM: Sebastian has an example of tiering on his blog: http://www.sebastien-han.fr/blog/2014/08/25/ceph-mix-sata-and-ssd-within-the-same-box/
[11:26] <TMM> Miouge, thanks!
[11:26] <sep> when using bluestore. is journals no longer needed ? or must you still use journals to optimize writing to the spinner ? assume the write is so large the cache effect in the journal is nill. ?
[11:26] <Miouge> TMM: he adds ???disktype??? between osd and host
[11:29] <TMM> Miouge, no, he creates to entirely separate roots
[11:30] <TMM> nvm, he does that later
[11:30] <TMM> Miouge, sorry! :)
[11:31] <Miouge> TMM: np. He does a ???root ssd???, ???root spinning???, then for each host there is ???_ssd??? host and a ???_spinning??? host as well
[11:32] <Miouge> I reproduced this in a test cluster, the trick is to set ???osd crush update on start = false???
[11:33] <TMM> I'm probably going for the multiple roots option then
[11:33] <TMM> seems like it would be less work
[11:41] * epicguy (~epicguy@41.164.8.42) Quit (Quit: Leaving)
[11:46] * PierreW (~drdanick@192.42.116.16) has joined #ceph
[11:52] * kawa2014 (~kawa@212.110.41.244) Quit (Ping timeout: 480 seconds)
[11:53] * ngoswami_ (~ngoswami@1.39.96.26) has joined #ceph
[11:57] * ngoswami (~ngoswami@1.39.96.26) Quit (Ping timeout: 480 seconds)
[11:58] * prallab (~prallab@106.51.129.244) has joined #ceph
[12:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[12:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[12:02] * kawa2014 (~kawa@89.184.114.246) has joined #ceph
[12:04] * m8x (~user@182.150.27.112) Quit (Remote host closed the connection)
[12:06] * prallab (~prallab@106.51.129.244) Quit (Ping timeout: 480 seconds)
[12:07] * EinstCrazy (~EinstCraz@58.247.119.250) Quit (Remote host closed the connection)
[12:08] * prallab (~prallab@106.51.142.172) has joined #ceph
[12:16] * prallab (~prallab@106.51.142.172) Quit (Ping timeout: 480 seconds)
[12:16] * PierreW (~drdanick@4MJAAFL08.tor-irc.dnsbl.oftc.net) Quit ()
[12:16] * Harryhy (~SinZ|offl@06SAAC3NU.tor-irc.dnsbl.oftc.net) has joined #ceph
[12:20] * karnan (~karnan@121.244.87.117) Quit (Ping timeout: 480 seconds)
[12:22] * Miouge (~Miouge@188.189.70.220) Quit (Ping timeout: 480 seconds)
[12:22] * nils_ (~nils_@doomstreet.collins.kg) has joined #ceph
[12:28] * krypto (~krypto@125.16.137.146) has joined #ceph
[12:31] * dgurtner (~dgurtner@178.197.225.26) Quit (Read error: Connection reset by peer)
[12:35] * Miouge (~Miouge@188.189.70.220) has joined #ceph
[12:35] * karnan (~karnan@121.244.87.117) has joined #ceph
[12:37] * rraja (~rraja@121.244.87.117) Quit (Ping timeout: 480 seconds)
[12:38] * Hemanth (~hkumar_@121.244.87.117) Quit (Quit: Leaving)
[12:43] * Miouge (~Miouge@188.189.70.220) Quit (Quit: Miouge)
[12:46] * Harryhy (~SinZ|offl@06SAAC3NU.tor-irc.dnsbl.oftc.net) Quit ()
[12:46] * Sirrush (~tokie@tor.ohundred.com) has joined #ceph
[12:47] * rraja (~rraja@121.244.87.118) has joined #ceph
[12:53] * rraja (~rraja@121.244.87.118) Quit (Quit: Leaving)
[12:53] * karnan (~karnan@121.244.87.117) Quit (Quit: Leaving)
[12:53] * rraja (~rraja@121.244.87.117) has joined #ceph
[12:53] * ngoswami__ (~ngoswami@1.39.96.26) has joined #ceph
[12:58] * fabioFVZ (~fabiofvz@213.187.10.8) has joined #ceph
[12:58] * fabioFVZ (~fabiofvz@213.187.10.8) Quit ()
[12:59] * fabioFVZ (~fabiofvz@213.187.10.8) has joined #ceph
[12:59] * fabioFVZ (~fabiofvz@213.187.10.8) Quit ()
[13:00] * ngoswami_ (~ngoswami@1.39.96.26) Quit (Ping timeout: 480 seconds)
[13:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[13:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[13:02] * zhaochao (~zhaochao@124.202.191.132) Quit (Quit: ChatZilla 0.9.92 [Firefox 45.1.1/20160507231935])
[13:05] * Miouge (~Miouge@188.189.70.220) has joined #ceph
[13:13] * fsimonce (~simon@host128-29-dynamic.250-95-r.retail.telecomitalia.it) Quit (Quit: Coyote finally caught me)
[13:15] * flisky (~Thunderbi@36.110.40.20) has joined #ceph
[13:16] * Sirrush (~tokie@06SAAC3OS.tor-irc.dnsbl.oftc.net) Quit ()
[13:16] * Nephyrin (~Pommesgab@chulak.enn.lu) has joined #ceph
[13:19] * Racpatel (~Racpatel@2601:87:3:3601::4edb) has joined #ceph
[13:23] * vicente (~~vicente@125-227-238-55.HINET-IP.hinet.net) Quit (Quit: Leaving)
[13:24] * prallab (~prallab@106.51.142.172) has joined #ceph
[13:25] * huangjun (~kvirc@113.57.168.154) Quit (Read error: Connection reset by peer)
[13:26] * ogzy (~oguzy@ogzy.user.oftc.net) Quit (Quit: Ex-Chat)
[13:32] * wjw-freebsd (~wjw@176.74.240.1) has joined #ceph
[13:32] * prallab (~prallab@106.51.142.172) Quit (Ping timeout: 480 seconds)
[13:33] * bniver (~bniver@71-9-144-29.static.oxfr.ma.charter.com) has joined #ceph
[13:34] * bene (~bene@2601:18c:8501:41d0:ea2a:eaff:fe08:3c7a) has joined #ceph
[13:43] * dgurtner (~dgurtner@178.197.225.26) has joined #ceph
[13:46] * Nephyrin (~Pommesgab@4MJAAFL4C.tor-irc.dnsbl.oftc.net) Quit ()
[13:46] * DoDzy (~Spikey@exit1.ipredator.se) has joined #ceph
[13:50] * deepthi (~deepthi@27.56.150.171) Quit (Quit: Leaving)
[13:52] * allaok (~allaok@ARennes-658-1-184-235.w92-139.abo.wanadoo.fr) has joined #ceph
[13:54] * ngoswami_ (~ngoswami@1.39.96.26) has joined #ceph
[13:57] * allaok (~allaok@ARennes-658-1-184-235.w92-139.abo.wanadoo.fr) Quit ()
[13:58] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[13:58] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[14:00] * georgem (~Adium@24.114.74.103) has joined #ceph
[14:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[14:01] * ngoswami__ (~ngoswami@1.39.96.26) Quit (Ping timeout: 480 seconds)
[14:04] * KindOne_ (~KindOne@h145.116.31.71.dynamic.ip.windstream.net) has joined #ceph
[14:05] * KindOne (kindone@0001a7db.user.oftc.net) Quit (Ping timeout: 480 seconds)
[14:05] * KindOne_ is now known as KindOne
[14:05] * kawa2014 (~kawa@89.184.114.246) Quit (Ping timeout: 480 seconds)
[14:07] * bene (~bene@2601:18c:8501:41d0:ea2a:eaff:fe08:3c7a) Quit (Quit: Konversation terminated!)
[14:08] * dgurtner (~dgurtner@178.197.225.26) Quit (Ping timeout: 480 seconds)
[14:09] * branto (~branto@ip-78-102-208-181.net.upcbroadband.cz) has joined #ceph
[14:14] * MentalRay (~MentalRay@107.171.161.165) has joined #ceph
[14:16] * DoDzy (~Spikey@06SAAC3RE.tor-irc.dnsbl.oftc.net) Quit ()
[14:16] * visored (~Snowman@tor2.asmer.com.ua) has joined #ceph
[14:18] * dgurtner (~dgurtner@178.197.225.26) has joined #ceph
[14:23] * rakeshgm (~rakesh@106.51.29.57) Quit (Quit: Leaving)
[14:30] * georgem (~Adium@24.114.74.103) Quit (Quit: Leaving.)
[14:33] * MentalRay (~MentalRay@107.171.161.165) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[14:44] * rwheeler (~rwheeler@pool-173-48-195-215.bstnma.fios.verizon.net) Quit (Quit: Leaving)
[14:46] * visored (~Snowman@06SAAC3ST.tor-irc.dnsbl.oftc.net) Quit ()
[14:46] * darkid (~nartholli@torland1-this.is.a.tor.exit.server.torland.is) has joined #ceph
[14:49] * rdas (~rdas@106.221.141.29) Quit (Read error: Connection reset by peer)
[14:50] * georgem (~Adium@206.108.127.16) has joined #ceph
[14:54] * Miouge (~Miouge@188.189.70.220) Quit (Ping timeout: 480 seconds)
[14:59] * ngoswami__ (~ngoswami@1.39.96.26) has joined #ceph
[15:00] * ngoswami_ (~ngoswami@1.39.96.26) Quit (Ping timeout: 480 seconds)
[15:02] * yebyen (~yebyen@129.21.49.95) has joined #ceph
[15:03] * kawa2014 (~kawa@dynamic-adsl-84-220-86-76.clienti.tiscali.it) has joined #ceph
[15:05] * mhack (~mhack@66-168-117-78.dhcp.oxfr.ma.charter.com) has joined #ceph
[15:08] * scg (~zscg@valis.gnu.org) has joined #ceph
[15:14] * dugravot6 (~dugravot6@nat-persul-plg.wifi.univ-lorraine.fr) Quit (Quit: Leaving.)
[15:16] * darkid (~nartholli@06SAAC3T7.tor-irc.dnsbl.oftc.net) Quit ()
[15:16] * superdug1 (~Lunk2@tor-exit.insane.us.to) has joined #ceph
[15:17] * ade (~abradshaw@dslb-188-103-020-040.188.103.pools.vodafone-ip.de) Quit (Quit: Too sexy for his shirt)
[15:21] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[15:21] * lxo (~aoliva@lxo.user.oftc.net) Quit (Remote host closed the connection)
[15:22] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[15:23] * dgurtner (~dgurtner@178.197.225.26) Quit (Ping timeout: 480 seconds)
[15:30] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[15:35] * Drankis (~martin@mikrotik.hostnet.lv) has joined #ceph
[15:36] * flisky (~Thunderbi@36.110.40.20) Quit (Ping timeout: 480 seconds)
[15:36] * dgurtner (~dgurtner@178.197.225.26) has joined #ceph
[15:40] * rwheeler (~rwheeler@nat-pool-bos-t.redhat.com) has joined #ceph
[15:46] * jdillaman (~jdillaman@pool-108-18-97-82.washdc.fios.verizon.net) has joined #ceph
[15:46] * superdug1 (~Lunk2@4MJAAFL9Y.tor-irc.dnsbl.oftc.net) Quit ()
[15:49] * Miouge (~Miouge@188.189.70.220) has joined #ceph
[15:59] * bvi (~Bastiaan@185.56.32.1) Quit (Quit: Leaving)
[16:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[16:01] * kefu_ is now known as kefu
[16:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[16:01] * bene (~bene@2601:18c:8501:41d0:ea2a:eaff:fe08:3c7a) has joined #ceph
[16:02] * KindOne (~KindOne@0001a7db.user.oftc.net) Quit (Ping timeout: 480 seconds)
[16:02] * KindOne (~KindOne@h118.147.186.173.dynamic.ip.windstream.net) has joined #ceph
[16:03] * garphy`aw is now known as garphy
[16:03] * scuttle|afk is now known as scuttlemonkey
[16:04] * ngoswami_ (~ngoswami@1.39.96.26) has joined #ceph
[16:06] * wushudoin (~wushudoin@2601:646:9501:d2b2:2ab2:bdff:fe0b:a6ee) has joined #ceph
[16:06] * ngoswami__ (~ngoswami@1.39.96.26) Quit (Ping timeout: 480 seconds)
[16:07] * wushudoin (~wushudoin@2601:646:9501:d2b2:2ab2:bdff:fe0b:a6ee) Quit ()
[16:07] * wushudoin (~wushudoin@2601:646:9501:d2b2:2ab2:bdff:fe0b:a6ee) has joined #ceph
[16:09] <WildOne> Hi again. Anyone online? :) I need advice regarding what sharding is on Ceph? Am I correct in that sharding is only relevant for RadosGW?
[16:10] * xarses (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[16:11] * linuxkidd (~linuxkidd@ip70-189-207-54.lv.lv.cox.net) Quit (Quit: Leaving)
[16:12] * linuxkidd (~linuxkidd@ip70-189-207-54.lv.lv.cox.net) has joined #ceph
[16:13] * bara (~bara@ip4-83-240-10-82.cust.nbox.cz) Quit (Quit: Bye guys! (??????????????????? ?????????)
[16:13] * jermudgeon (~jhaustin@southend.mdu.whitestone.link) has joined #ceph
[16:16] * Scymex (~OODavo@109.201.133.100) has joined #ceph
[16:17] * MentalRay (~MentalRay@MTRLPQ42-1176054809.sdsl.bell.ca) has joined #ceph
[16:19] <nils_> WildOne, signs point to yes ;)
[16:20] * MrAbaddon (~MrAbaddon@194.38.159.250) has joined #ceph
[16:21] * flisky (~Thunderbi@124.207.50.249) has joined #ceph
[16:22] * linjan (~linjan@86.62.112.22) Quit (Ping timeout: 480 seconds)
[16:23] <IcePic> unless one uses "sharing" in a wide sense to cover any kind of split of large data onto several servers.
[16:23] <IcePic> sharDing*
[16:24] * vbellur (~vijay@71.234.224.255) Quit (Ping timeout: 480 seconds)
[16:26] * shaunm (~shaunm@74.83.215.100) Quit (Ping timeout: 480 seconds)
[16:34] * vikhyat (~vumrao@123.252.148.25) Quit (Quit: Leaving)
[16:34] * MannerMan (~oscar@user170.217-10-117.netatonce.net) Quit (Quit: Leaving)
[16:35] * flisky (~Thunderbi@124.207.50.249) Quit (Quit: flisky)
[16:35] * ngoswami_ (~ngoswami@1.39.96.26) Quit (Quit: Leaving)
[16:39] * xarses (~xarses@64.124.158.100) has joined #ceph
[16:43] * prallab (~prallab@106.51.142.172) has joined #ceph
[16:44] * T1w (~jens@node3.survey-it.dk) Quit (Ping timeout: 480 seconds)
[16:46] * Scymex (~OODavo@7V7AAFBWD.tor-irc.dnsbl.oftc.net) Quit ()
[16:47] * debian112 (~bcolbert@24.126.201.64) Quit (Ping timeout: 480 seconds)
[16:51] * nupanick (~skrblr@159.148.186.194) has joined #ceph
[16:51] * Drankis (~martin@mikrotik.hostnet.lv) Quit (Quit: Leaving)
[16:51] * prallab (~prallab@106.51.142.172) Quit (Ping timeout: 480 seconds)
[16:54] * jermudgeon (~jhaustin@southend.mdu.whitestone.link) Quit (Quit: jermudgeon)
[16:56] * Miouge (~Miouge@188.189.70.220) Quit (Quit: Miouge)
[17:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[17:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[17:02] * analbeard (~shw@support.memset.com) Quit (Quit: Leaving.)
[17:03] * debian112 (~bcolbert@24.126.201.64) has joined #ceph
[17:12] <Walex> so so so... I am bout to start using S3 access via RADOSgw
[17:12] * sudocat (~dibarra@104-188-116-197.lightspeed.hstntx.sbcglobal.net) has joined #ceph
[17:13] <Walex> the question is: what does an S3 "bucket" translate to in Ceph/RADOS object?
[17:13] * overclk (~quassel@121.244.87.117) Quit (Remote host closed the connection)
[17:14] <Walex> and whatever corresponds to an S3 "bucket" in Ceph/RADOS, hwo many sub-files can it realistically contain?
[17:14] * rraja (~rraja@121.244.87.117) Quit (Quit: Leaving)
[17:15] * _28_ria (~kvirc@opfr028.ru) Quit (Read error: Connection reset by peer)
[17:16] * vata (~vata@207.96.182.162) has joined #ceph
[17:17] * _28_ria (~kvirc@opfr028.ru) has joined #ceph
[17:19] * EinstCrazy (~EinstCraz@116.238.106.67) has joined #ceph
[17:20] * sudocat (~dibarra@104-188-116-197.lightspeed.hstntx.sbcglobal.net) Quit (Ping timeout: 480 seconds)
[17:21] * wes_dillingham (~wes_dilli@140.247.242.44) has joined #ceph
[17:21] * nupanick (~skrblr@7V7AAFBX6.tor-irc.dnsbl.oftc.net) Quit ()
[17:21] * Jones (~Quackie@turing.tor-exit.calyxinstitute.org) has joined #ceph
[17:22] * wjw-freebsd (~wjw@176.74.240.1) Quit (Ping timeout: 480 seconds)
[17:23] * prallab (~prallab@106.51.142.172) has joined #ceph
[17:24] * rmart04 (~rmart04@support.memset.com) has joined #ceph
[17:24] * Brochacho (~alberto@c-73-45-127-198.hsd1.il.comcast.net) has joined #ceph
[17:25] <wes_dillingham> I have noticed that when doing an `rbd export-diff ???whole-object <device> | import-diff <backup-device> that the resulting snapshots of the two devices when exported as a raw file have differing md5s but this is not the case when not using ???whole-object. My interpretation of the documentation is that ???whole-object on an export diff exports the entire changed underlying object, whereas not specifying ???whole-object results in just the
[17:25] <wes_dillingham> differences within the underlying object being exported. In both cases the resulting devices should be identical, but as i have tested they are not??? what am i missing?
[17:26] <wes_dillingham> Not sure if that was clear???. using ???whole-object causes the md5s on the snapshots to differ, not using ???whole-object the md5s of the exported snapshots are identical
[17:27] * WhiteBxEng (~whitebxen@ip72-208-208-76.ph.ph.cox.net) has joined #ceph
[17:27] * dillaman (~jdillaman@pool-108-18-97-82.washdc.fios.verizon.net) Quit (Quit: Leaving)
[17:30] * prallab_ (~prallab@106.51.139.137) has joined #ceph
[17:31] * prallab (~prallab@106.51.142.172) Quit (Ping timeout: 480 seconds)
[17:31] <Walex> on the question I asked before a to the mapping of S3 buckets, they are apparently mapped to pools, and there is this page that gives some suggestions: https://access.redhat.com/documentation/en/red-hat-ceph-storage/version-1.3/red-hat-ceph-storage-13-ceph-object-gateway-for-rhel-x86-64/#configure-bucket-sharding
[17:32] * sudocat (~dibarra@192.185.1.20) has joined #ceph
[17:32] * Skaag (~lunix@cpe-172-91-77-84.socal.res.rr.com) Quit (Quit: Leaving.)
[17:36] * TMM (~hp@185.5.121.201) Quit (Quit: Ex-Chat)
[17:37] <Walex> also: http://www.spinics.net/lists/ceph-users/msg21388.html
[17:38] * prallab_ (~prallab@106.51.139.137) Quit (Ping timeout: 480 seconds)
[17:39] * mykola (~Mikolaj@91.245.76.80) has joined #ceph
[17:42] * evelu (~erwan@37.160.216.122) Quit (Read error: Connection reset by peer)
[17:42] * ntpttr_laptop (~ntpttr@192.55.54.42) has joined #ceph
[17:43] * jordanP (~jordan@204.13-14-84.ripe.coltfrance.com) Quit (Quit: Leaving)
[17:47] * billwebb (~billwebb@50-203-47-138-static.hfc.comcastbusiness.net) has joined #ceph
[17:48] * jermudgeon (~jhaustin@gw1.ttp.biz.whitestone.link) has joined #ceph
[17:51] * Jones (~Quackie@06SAAC320.tor-irc.dnsbl.oftc.net) Quit ()
[17:51] * kefu (~kefu@114.92.122.74) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[17:51] * xul (~cmrn@4MJAAFMHL.tor-irc.dnsbl.oftc.net) has joined #ceph
[17:54] * kefu (~kefu@183.193.181.153) has joined #ceph
[17:55] * dgurtner (~dgurtner@178.197.225.26) Quit (Read error: No route to host)
[17:56] * evelu (~erwan@2a01:e34:eecb:7400:4eeb:42ff:fedc:8ac) has joined #ceph
[17:58] * Skaag (~lunix@65.200.54.234) has joined #ceph
[18:00] * billwebb (~billwebb@50-203-47-138-static.hfc.comcastbusiness.net) Quit (Quit: billwebb)
[18:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[18:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[18:02] * dillaman (~jdillaman@pool-108-18-97-82.washdc.fios.verizon.net) has joined #ceph
[18:03] * billwebb (~billwebb@50-203-47-138-static.hfc.comcastbusiness.net) has joined #ceph
[18:04] * kawa2014 (~kawa@dynamic-adsl-84-220-86-76.clienti.tiscali.it) Quit (Quit: Leaving)
[18:05] * kefu_ (~kefu@114.92.122.74) has joined #ceph
[18:05] * derjohn_mob (~aj@185.65.67.249) has joined #ceph
[18:12] * mhuang (~mhuang@60.28.116.219) has joined #ceph
[18:12] * kefu (~kefu@183.193.181.153) Quit (Ping timeout: 480 seconds)
[18:13] * wushudoin (~wushudoin@2601:646:9501:d2b2:2ab2:bdff:fe0b:a6ee) Quit (Remote host closed the connection)
[18:14] * wushudoin (~wushudoin@2601:646:9501:d2b2:2ab2:bdff:fe0b:a6ee) has joined #ceph
[18:18] * MentalRay (~MentalRay@MTRLPQ42-1176054809.sdsl.bell.ca) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[18:20] * linjan (~linjan@176.195.235.8) has joined #ceph
[18:20] * MentalRay (~MentalRay@MTRLPQ42-1176054809.sdsl.bell.ca) has joined #ceph
[18:21] * xul (~cmrn@4MJAAFMHL.tor-irc.dnsbl.oftc.net) Quit ()
[18:21] * blip2 (~oracular@marylou.nos-oignons.net) has joined #ceph
[18:23] * mattt (~mattt@lnx1.defunct.ca) Quit (Remote host closed the connection)
[18:24] * shaunm (~shaunm@cpe-192-180-17-174.kya.res.rr.com) has joined #ceph
[18:25] * joshd1 (~jdurgin@71-92-201-212.dhcp.gldl.ca.charter.com) Quit (Quit: Leaving.)
[18:26] * artym (~artym@87.249.198.99) has joined #ceph
[18:26] * rmart04 (~rmart04@support.memset.com) Quit (Quit: rmart04)
[18:27] * branto (~branto@ip-78-102-208-181.net.upcbroadband.cz) Quit (Quit: Leaving.)
[18:27] * artym (~artym@87.249.198.99) Quit (Remote host closed the connection)
[18:32] * madkiss (~madkiss@p50914BC7.dip0.t-ipconnect.de) has joined #ceph
[18:38] * wes_dillingham (~wes_dilli@140.247.242.44) Quit (Quit: wes_dillingham)
[18:39] * mhuang (~mhuang@60.28.116.219) Quit (Quit: This computer has gone to sleep)
[18:39] * EinstCrazy (~EinstCraz@116.238.106.67) Quit (Remote host closed the connection)
[18:45] * antongribok (~antongrib@216.207.42.140) has joined #ceph
[18:46] * vasu (~vasu@c-73-231-60-138.hsd1.ca.comcast.net) has joined #ceph
[18:48] * yanzheng2 (~zhyan@118.116.112.223) Quit (Ping timeout: 480 seconds)
[18:49] * yanzheng (~zhyan@118.116.112.223) has joined #ceph
[18:51] * blip2 (~oracular@4MJAAFMI9.tor-irc.dnsbl.oftc.net) Quit ()
[18:51] * Kayla (~cryptk@06SAAC37J.tor-irc.dnsbl.oftc.net) has joined #ceph
[18:58] * prallab (~prallab@106.51.139.137) has joined #ceph
[19:00] * newbie (~kvirc@host217-114-156-249.pppoe.mark-itt.net) has joined #ceph
[19:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[19:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[19:04] * dnunez (~dnunez@nat-pool-bos-t.redhat.com) has joined #ceph
[19:06] * prallab (~prallab@106.51.139.137) Quit (Ping timeout: 480 seconds)
[19:11] * jdillaman (~jdillaman@pool-108-18-97-82.washdc.fios.verizon.net) Quit (Quit: jdillaman)
[19:12] * krypto (~krypto@125.16.137.146) Quit (Quit: Leaving)
[19:15] * madkiss (~madkiss@p50914BC7.dip0.t-ipconnect.de) Quit (Quit: Leaving.)
[19:16] * DV (~veillard@2001:41d0:a:f29f::1) has joined #ceph
[19:21] * Kayla (~cryptk@06SAAC37J.tor-irc.dnsbl.oftc.net) Quit ()
[19:21] * MrAbaddon (~MrAbaddon@194.38.159.250) Quit (Remote host closed the connection)
[19:21] * wjw-freebsd (~wjw@smtp.digiware.nl) has joined #ceph
[19:22] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:bdec:41f7:40ac:73c4) Quit (Ping timeout: 480 seconds)
[19:24] * MentalRay (~MentalRay@MTRLPQ42-1176054809.sdsl.bell.ca) Quit (Quit: Textual IRC Client: www.textualapp.com)
[19:25] * MentalRay (~MentalRay@MTRLPQ42-1176054809.sdsl.bell.ca) has joined #ceph
[19:26] * DV (~veillard@2001:41d0:a:f29f::1) Quit (Ping timeout: 480 seconds)
[19:28] <cholcombe> Walex, S3 objects are chunked like other objects in Ceph. The special thing in the radosgw is that it keeps an index to keep track of all the pieces that are part of an object. I believe that's correct
[19:29] <cholcombe> sep, the journal is eliminated for the most part in bluestore afaik
[19:29] <cholcombe> sep, rocksdb has it's own little journal
[19:37] * DV (~veillard@2001:41d0:a:f29f::1) has joined #ceph
[19:45] * MentalRay (~MentalRay@MTRLPQ42-1176054809.sdsl.bell.ca) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[19:45] * wes_dillingham (~wes_dilli@140.247.242.44) has joined #ceph
[19:47] * madkiss (~madkiss@p50914BC7.dip0.t-ipconnect.de) has joined #ceph
[19:47] * vasu (~vasu@c-73-231-60-138.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[19:48] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:8490:50ec:39e9:deca) has joined #ceph
[19:55] * vasu (~vasu@c-73-231-60-138.hsd1.ca.comcast.net) has joined #ceph
[19:55] * w2k (~CoMa@tor-exit0.intersafeit.com) has joined #ceph
[19:58] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:8490:50ec:39e9:deca) Quit (Ping timeout: 480 seconds)
[20:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[20:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[20:01] * DV (~veillard@2001:41d0:a:f29f::1) Quit (Ping timeout: 480 seconds)
[20:04] * MentalRay (~MentalRay@MTRLPQ42-1176054809.sdsl.bell.ca) has joined #ceph
[20:14] * wushudoin (~wushudoin@2601:646:9501:d2b2:2ab2:bdff:fe0b:a6ee) Quit (Ping timeout: 480 seconds)
[20:16] * rwheeler (~rwheeler@nat-pool-bos-t.redhat.com) Quit (Quit: Leaving)
[20:20] * madkiss (~madkiss@p50914BC7.dip0.t-ipconnect.de) Quit (Quit: Leaving.)
[20:25] * w2k (~CoMa@06SAAC4A1.tor-irc.dnsbl.oftc.net) Quit ()
[20:25] * ZombieTree (~Moriarty@tollana.enn.lu) has joined #ceph
[20:48] * redf (~red@80-108-89-163.cable.dynamic.surfer.at) has joined #ceph
[20:51] * yanzheng1 (~zhyan@118.116.112.223) has joined #ceph
[20:52] * yanzheng (~zhyan@118.116.112.223) Quit (Ping timeout: 480 seconds)
[20:54] * ntpttr_laptop (~ntpttr@192.55.54.42) Quit (Remote host closed the connection)
[20:55] * jermudgeon (~jhaustin@gw1.ttp.biz.whitestone.link) Quit (Quit: jermudgeon)
[20:55] * ZombieTree (~Moriarty@4MJAAFMPI.tor-irc.dnsbl.oftc.net) Quit ()
[20:55] * Snowcat4 (~JamesHarr@d01.brandonann.in) has joined #ceph
[20:59] * vbellur (~vijay@71.234.224.255) has joined #ceph
[21:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[21:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[21:04] * antongribok (~antongrib@216.207.42.140) Quit (Quit: Leaving...)
[21:05] * wes_dillingham (~wes_dilli@140.247.242.44) Quit (Ping timeout: 480 seconds)
[21:07] * TomasCZ (~TomasCZ@yes.tenlab.net) has joined #ceph
[21:07] * bene (~bene@2601:18c:8501:41d0:ea2a:eaff:fe08:3c7a) Quit (Quit: Konversation terminated!)
[21:18] * kefu_ (~kefu@114.92.122.74) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[21:20] <jiffe> so I've installed ceph on ubunt 16.04 using
[21:20] <jiffe> 'deb https://download.ceph.com/debian-jewel/ xenial main' but the init script doesn't seem to start ceph
[21:25] * Snowcat4 (~JamesHarr@06SAAC4EA.tor-irc.dnsbl.oftc.net) Quit ()
[21:25] * lmg (~AG_Clinto@exit1.ipredator.se) has joined #ceph
[21:36] <TheSov> doesnt work on 16.04
[21:37] <TheSov> use 14
[21:40] * TMM (~hp@178-84-46-106.dynamic.upc.nl) has joined #ceph
[21:41] * ntpttr_laptop (~ntpttr@jfdmzpr02-ext.jf.intel.com) has joined #ceph
[21:41] <jiffe> what doesn't work on 16.04
[21:42] <jiffe> it seems to work fine, just the startup script didn't work
[21:42] <jiffe> I haven't done depth testing yet but so far thats the only problem I've seen
[21:45] * dnunez (~dnunez@nat-pool-bos-t.redhat.com) Quit (Quit: Leaving)
[21:47] * stiopa (~stiopa@cpc73832-dals21-2-0-cust453.20-2.cable.virginm.net) has joined #ceph
[21:49] * mykola (~Mikolaj@91.245.76.80) Quit (Remote host closed the connection)
[21:53] <TheSov> bluestores dont work on 16.05
[21:53] <TheSov> bluestores dont work on 16.04
[21:55] * scuttlemonkey is now known as scuttle|afk
[21:55] * lmg (~AG_Clinto@06SAAC4FS.tor-irc.dnsbl.oftc.net) Quit ()
[21:56] <jiffe> I don't think I've done anything with bluestore
[21:58] * rwheeler (~rwheeler@pool-173-48-195-215.bstnma.fios.verizon.net) has joined #ceph
[22:00] <jiffe> yeah it sounds like that sits right on top of a block device so we haven't used that
[22:00] <TMM> I'm trying to run a ceph cluster on top of a avago SAS3008 controller with some sas expanders. I run 48 OSDs per box, 5 boxes, separate boxes for mons. Whenever I put the cluster under any serious load I'm starting to get scsi timeouts and resets, stalling the entire cluster.
[22:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[22:01] <TMM> Has anyone else seen this, or something similar?
[22:01] <TMM> I have 250GB of ram in those boxes and 20 physical cores, 40 threads
[22:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[22:02] <TMM> I'm able to trigger it in seconds with fio/rbd with 10 clients
[22:02] <TMM> both when running on ssds as well as spinnders without journals at all
[22:06] * danieagle (~Daniel@179.98.86.45) has joined #ceph
[22:07] * rendar (~I@host213-59-dynamic.22-79-r.retail.telecomitalia.it) Quit (Ping timeout: 480 seconds)
[22:19] * georgem (~Adium@206.108.127.16) Quit (Quit: Leaving.)
[22:20] <TMM> how how fun, disabling ncq fixes it
[22:20] <TMM> who needs that anyway
[22:21] <TMM> I think I'm going to have to have another word with my vendor
[22:21] * bniver (~bniver@71-9-144-29.static.oxfr.ma.charter.com) Quit (Quit: Leaving)
[22:23] <T1> TMM: ncq the scheduler?
[22:24] <TMM> no, native command queueing
[22:24] <T1> oh
[22:25] <T1> normally I wouldn't turn that off
[22:25] * shaunm (~shaunm@cpe-192-180-17-174.kya.res.rr.com) Quit (Ping timeout: 480 seconds)
[22:26] <TMM> no, that's not exactly my ideal situation either
[22:26] <TMM> but at least it's something I can point at
[22:26] <T1> using the latest megaraid driver?
[22:26] <TMM> yeah, latest from their website even
[22:26] <TMM> backported 13.00 driver
[22:26] <T1> I updated on RHEL7 from the stock version to a later non-avago version
[22:27] <T1> but to the dell-provided version
[22:27] <TMM> which one?
[22:27] <TMM> I could try that too I suppose, even though mine's not dell
[22:27] <TMM> which one did you get?
[22:27] <T1> not on ceph nodes, but it was a later driver version compared to stock
[22:27] <T1> uhmm.. good guestion.. :)
[22:28] <T1> it had LSI all over it compared to the stock that mentioned Avago
[22:28] <T1> go to support.dell.com
[22:28] <T1> find a R730xdpoweredge server
[22:28] <T1> argh..
[22:28] <T1> 730xd poweredge even
[22:28] <T1> find a driver for a PERC H830 (SAS raid) card
[22:29] <T1> or H730 or similar
[22:29] <T1> that's the megaraid_sas driver
[22:30] * W|ldCraze (~Azru@edwardsnowden0.torservers.net) has joined #ceph
[22:33] * rendar (~I@host213-59-dynamic.22-79-r.retail.telecomitalia.it) has joined #ceph
[22:34] <TMM> ah, mine doesn't use that driver
[22:34] <TMM> it's the mpt3sas driver
[22:34] * MrAbaddon (~MrAbaddon@a89-155-99-93.cpe.netcabo.pt) has joined #ceph
[22:36] * evelu (~erwan@2a01:e34:eecb:7400:4eeb:42ff:fedc:8ac) Quit (Ping timeout: 480 seconds)
[22:41] * cathode (~cathode@50.232.215.114) has joined #ceph
[22:43] * dgurtner (~dgurtner@178.197.225.26) has joined #ceph
[22:43] * nils_ (~nils_@doomstreet.collins.kg) Quit (Quit: This computer has gone to sleep)
[22:44] <jiffe> anyone else had systemd startup issues on ubuntu 16.04 ?
[22:57] <TMM> jiffe, do your osds come up when you run systemctl reset-failed ceph-osd@*
[22:57] <TMM> and then partprobe
[22:57] <TMM> ?
[22:57] <TMM> because if 'yes' you're seeing the same issue I'm seeing :)
[23:00] * W|ldCraze (~Azru@06SAAC4IO.tor-irc.dnsbl.oftc.net) Quit ()
[23:00] * Malcovent (~TGF@edwardsnowden1.torservers.net) has joined #ceph
[23:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[23:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[23:01] <TMM> it seems that udev triggers too soon, at least for me
[23:02] * scg (~zscg@valis.gnu.org) Quit (Quit: Leaving)
[23:05] * ira (~ira@c-24-34-255-34.hsd1.ma.comcast.net) has joined #ceph
[23:09] * DJVG (~DJVG@2001:470:1f15:3cd::2) Quit (Ping timeout: 480 seconds)
[23:13] * i_m (~ivan.miro@nat-5-carp.hcn-strela.ru) Quit (Quit: Leaving.)
[23:14] * i_m (~ivan.miro@nat-5-carp.hcn-strela.ru) has joined #ceph
[23:16] * ieth0 (~ieth0@m83-185-86-185.cust.tele2.se) has joined #ceph
[23:18] * ira (~ira@c-24-34-255-34.hsd1.ma.comcast.net) Quit (Quit: Leaving)
[23:23] * dneary (~dneary@nat-pool-bos-u.redhat.com) Quit (Ping timeout: 480 seconds)
[23:27] <jiffe> TMM: systemctl start ceph-mon@ceph-maildump-mon3.service will bring it up but not systemctl start ceph (same for osd) and doesn't come up on boot
[23:28] * i_m (~ivan.miro@nat-5-carp.hcn-strela.ru) Quit (Ping timeout: 480 seconds)
[23:28] <TMM> oh, you're talking about the mons
[23:28] <TMM> I didn't have that problem
[23:28] <TMM> did you enable that unit?
[23:28] <TMM> systemctl enable ceph-mon@ceph-maildump-mon3.service
[23:28] <TMM> ?
[23:29] <jiffe> both mon and osd and yeah they're enabled
[23:30] * Malcovent (~TGF@4MJAAFMVW.tor-irc.dnsbl.oftc.net) Quit ()
[23:30] * Da_Pineapple (~Grum@7V7AAFCHT.tor-irc.dnsbl.oftc.net) has joined #ceph
[23:30] <jiffe> actually haven't tested the osd boot in a while since that's not a vm, let me test that out
[23:32] * ieth0_ (~ieth0@user232.77-105-223.netatonce.net) has joined #ceph
[23:34] <jiffe> yeah osd isn't coming up on boot either still
[23:34] * ieth0 (~ieth0@m83-185-86-185.cust.tele2.se) Quit (Read error: Connection reset by peer)
[23:34] * ieth0_ is now known as ieth0
[23:37] * vata (~vata@207.96.182.162) Quit (Quit: Leaving.)
[23:37] * WildOne (~simba@213.141.155.237) Quit (Ping timeout: 480 seconds)
[23:37] * Racpatel (~Racpatel@2601:87:3:3601::4edb) Quit (Ping timeout: 480 seconds)
[23:38] <jiffe> after after boot, systemctl status ceph-mon@ceph-maildump-mon3.service says Loaded: loaded (/lib/systemd/system/ceph-mon@.service; enabled; vendor preset: enabled) / Active: inactive (dead)
[23:40] * rdias (~rdias@2001:8a0:749a:d01:4d3e:14b9:21c2:f076) Quit (Ping timeout: 480 seconds)
[23:45] * rdias (~rdias@2001:8a0:749a:d01:8d21:22e6:350:67de) has joined #ceph
[23:48] <jiffe> modified the /etc/init.d/ceph script and seems to work now
[23:53] * khyron (~khyron@189.217.27.254) has joined #ceph
[23:53] * newbie (~kvirc@host217-114-156-249.pppoe.mark-itt.net) Quit (Ping timeout: 480 seconds)

These logs were automatically created by CephLogBot on irc.oftc.net using the Java IRC LogBot.