#ceph IRC Log

Index

IRC Log for 2016-07-05

Timestamps are in GMT/BST.

[0:01] * DV_ (~veillard@2001:41d0:a:f29f::1) has joined #ceph
[0:13] * penguinRaider (~KiKo@69.163.33.182) Quit (Remote host closed the connection)
[0:13] * penguinRaider (~KiKo@69.163.33.182) has joined #ceph
[0:30] * MentalRay (~MentalRay@MTRLPQ42-1176054809.sdsl.bell.ca) Quit (Ping timeout: 480 seconds)
[0:30] * vata1 (~vata@207.96.182.162) Quit (Remote host closed the connection)
[0:44] * rendar (~I@host47-183-dynamic.7-87-r.retail.telecomitalia.it) Quit (Quit: std::lower_bound + std::less_equal *works* with a vector without duplicates!)
[0:52] * derjohn_mob (~aj@p578b6aa1.dip0.t-ipconnect.de) has joined #ceph
[1:02] * stiopa (~stiopa@cpc73832-dals21-2-0-cust453.20-2.cable.virginm.net) Quit (Ping timeout: 480 seconds)
[1:06] * xarses_ (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) has joined #ceph
[1:16] * toMeloos (~toMeloos@53568B3D.cm-6-7c.dynamic.ziggo.nl) Quit (Ping timeout: 480 seconds)
[1:24] * jwandborg (~PappI@46.166.188.236) has joined #ceph
[1:27] * kuku (~kuku@119.93.91.136) has joined #ceph
[1:30] * Gugge_47527 (gugge@92.246.2.105) has joined #ceph
[1:30] * Gugge-47527 (gugge@92.246.2.105) Quit (Ping timeout: 480 seconds)
[1:30] * Gugge_47527 is now known as Gugge-47527
[1:31] * nhm (~nhm@c-50-171-139-246.hsd1.mn.comcast.net) has joined #ceph
[1:31] * ChanServ sets mode +o nhm
[1:36] * neurodrone (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) Quit (Quit: neurodrone)
[1:36] * jwandborg (~PappI@46.166.188.236) Quit (Ping timeout: 480 seconds)
[1:38] * neurodrone (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) has joined #ceph
[1:41] * albertom (~albertom@134.134.139.83) Quit (Quit: Leaving...)
[1:45] * kevinc (~kevinc__@ip174-65-68-173.sd.sd.cox.net) has joined #ceph
[1:45] * kevinc (~kevinc__@ip174-65-68-173.sd.sd.cox.net) Quit ()
[1:45] * kevinc (~kevinc__@2600:8801:9600:21:b0c8:415b:f1f8:a9a3) has joined #ceph
[1:45] * kevinc (~kevinc__@2600:8801:9600:21:b0c8:415b:f1f8:a9a3) Quit ()
[1:55] * psieklFH (psiekl@wombat.eu.org) Quit (Ping timeout: 480 seconds)
[2:01] * psiekl (psiekl@wombat.eu.org) has joined #ceph
[2:11] * rushworld (~Hejt@ns316491.ip-37-187-129.eu) has joined #ceph
[2:13] * o0c_ (~o0c@chris.any.mx) Quit (Ping timeout: 480 seconds)
[2:13] <kuku> mistur, sorry for the late reply. The mon is not running. I've tried to reboot and restart the service of my mon. To no avail its still doesn't work. I've tried to ceph-deploy mon create-initial. It displays: http://dpaste.com/0VG5BPA
[2:13] * bauruine (~bauruine@2a01:4f8:202:54c7::beef) Quit (Ping timeout: 480 seconds)
[2:15] * bauruine (~bauruine@2a01:4f8:202:54c7::beef) has joined #ceph
[2:16] * o0c (~o0c@chris.any.mx) has joined #ceph
[2:19] <kuku> I just look at the log of my ceph02 and found this. http://dpaste.com/1CGABFR I think the ceph02 is running but not the mon.
[2:22] * jargonmonk (~jmnk@123.201.112.108) Quit (Quit: Leaving)
[2:25] * Kingrat (~shiny@2605:a000:161a:c0f6:4899:5e0d:3f:f14d) Quit (Ping timeout: 480 seconds)
[2:31] * kuku (~kuku@119.93.91.136) Quit (Read error: Connection reset by peer)
[2:41] * rushworld (~Hejt@06SAAEUNZ.tor-irc.dnsbl.oftc.net) Quit ()
[2:44] * kuku (~kuku@119.93.91.136) has joined #ceph
[2:48] * Kingrat (~shiny@2605:a000:161a:c0f6:f0de:64b3:64f7:2f96) has joined #ceph
[2:50] * huangjun (~kvirc@113.57.168.154) has joined #ceph
[3:00] * danieagle (~Daniel@187.75.19.157) Quit (Quit: Obrigado por Tudo! :-) inte+ :-))
[3:01] <jiffe> does ceph have a lot of overhead?
[3:02] * borei (~dan@node-1w7jr9qle4x5ix2kjybp8d4fv.ipv6.telus.net) Quit (Ping timeout: 480 seconds)
[3:02] <jiffe> I'm moving content from mongodb to ceph and mongodb currently takes up about 65% of the disk space
[3:03] <jiffe> I've moved 1/164th of the content so far and doing forward projections I'm going to be at about 100% disk space utilization on ceph when its done
[3:04] * neurodrone (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) Quit (Quit: neurodrone)
[3:04] <jiffe> and actually since I've moved from a 12 disk raid 50 to 10 disks with raid0 ceph actually has more disk space available to it
[3:05] <Kingrat> depending on your replica size, which is 3 by default, you would need that times the amount of storage space for your data
[3:06] <jiffe> my replica size is two and I've taken that into account
[3:08] * georgem (~Adium@45.72.156.229) has joined #ceph
[3:10] <jiffe> the content is binary since it is compressed but I wouldn't think that would matter
[3:11] * neurodrone (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) has joined #ceph
[3:13] <jiffe> there's also going to be about 500M distinct objects
[3:16] * neurodrone (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) Quit (Quit: neurodrone)
[3:21] * dyasny (~dyasny@cable-192.222.152.136.electronicbox.net) Quit (Ping timeout: 480 seconds)
[3:26] <jiffe> ah, looking in the osds I see each has a 5G journal, that skews my calculations
[3:27] * yanzheng (~zhyan@125.70.20.240) has joined #ceph
[3:28] <jiffe> so taking that into account I project around 76% utilizationb
[3:28] <Kingrat> doesnt give you much room to grow
[3:29] <badone> and during recovery you may push limits
[3:39] <jiffe> well growth would come in the form of another set of machines to add more osds
[3:39] <jiffe> recovery will use more space though?
[3:40] <badone> jiffe: it can use considerably more space, yes
[3:44] * EinstCrazy (~EinstCraz@60-249-152-164.HINET-IP.hinet.net) has joined #ceph
[3:47] * neurodrone (~neurodron@162.243.191.67) has joined #ceph
[3:48] <jiffe> what is being done that uses space in addition to the normal usage?
[3:54] * wes_dillingham (~wes_dilli@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) has joined #ceph
[4:00] <badone> jiffe: read the definition of PG temp and consider the implications, http://docs.ceph.com/docs/master/dev/peering/
[4:00] * EinstCra_ (~EinstCraz@58.247.117.134) has joined #ceph
[4:01] * flisky (~Thunderbi@210.12.157.92) has joined #ceph
[4:04] * neurodrone (~neurodron@162.243.191.67) Quit (Quit: neurodrone)
[4:05] * EinstCrazy (~EinstCraz@60-249-152-164.HINET-IP.hinet.net) Quit (Ping timeout: 480 seconds)
[4:06] * EinstCrazy (~EinstCraz@58.247.117.134) has joined #ceph
[4:06] * neurodrone (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) has joined #ceph
[4:07] * kuku (~kuku@119.93.91.136) Quit (Remote host closed the connection)
[4:09] <badone> jiffe: and... http://docs.ceph.com/docs/hammer/rados/troubleshooting/troubleshooting-osd/#no-free-drive-space
[4:09] <badone> just sayin'
[4:11] * EinstCra_ (~EinstCraz@58.247.117.134) Quit (Ping timeout: 480 seconds)
[4:15] * flisky (~Thunderbi@210.12.157.92) Quit (Remote host closed the connection)
[4:15] * flisky (~Thunderbi@210.12.157.88) has joined #ceph
[4:16] * ChengPeng (~chris@180.168.126.179) has left #ceph
[4:16] * ChengPeng (~chris@180.168.126.179) has joined #ceph
[4:22] * flisky (~Thunderbi@210.12.157.88) Quit (Remote host closed the connection)
[4:36] * vicente (~~vicente@125-227-238-55.HINET-IP.hinet.net) has joined #ceph
[4:52] * neurodrone (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) Quit (Quit: neurodrone)
[4:53] * realitysandwich (~perry@b2b-78-94-59-114.unitymedia.biz) Quit (Ping timeout: 480 seconds)
[4:53] * kuku (~kuku@119.93.91.136) has joined #ceph
[4:54] * wes_dillingham (~wes_dilli@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) Quit (Quit: wes_dillingham)
[4:57] * neurodrone (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) has joined #ceph
[5:06] * MentalRay (~MentalRay@LPRRPQ1401W-LP130-02-1242363207.dsl.bell.ca) has joined #ceph
[5:06] * borei (~dan@node-1w7jr9qle4x5ix2kjybp8d4fv.ipv6.telus.net) has joined #ceph
[5:12] * gauravbafna (~gauravbaf@223.227.239.109) has joined #ceph
[5:13] * wes_dillingham (~wes_dilli@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) has joined #ceph
[5:15] * neurodrone (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) Quit (Quit: neurodrone)
[5:20] * gauravbafna (~gauravbaf@223.227.239.109) Quit (Ping timeout: 480 seconds)
[5:25] * vata (~vata@cable-173.246.3-246.ebox.ca) Quit (Quit: Leaving.)
[5:27] * georgem (~Adium@45.72.156.229) Quit (Quit: Leaving.)
[5:28] * neurodrone (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) has joined #ceph
[5:29] * gauravbafna (~gauravbaf@223.227.239.109) has joined #ceph
[5:29] * wes_dillingham (~wes_dilli@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) Quit (Quit: wes_dillingham)
[5:29] * neurodrone (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) Quit ()
[5:36] * hellertime (~Adium@a72-246-0-10.deploy.akamaitechnologies.com) Quit (Ping timeout: 480 seconds)
[5:37] * gauravbafna (~gauravbaf@223.227.239.109) Quit (Ping timeout: 480 seconds)
[5:38] * wes_dillingham (~wes_dilli@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) has joined #ceph
[5:41] * Vacuum_ (~Vacuum@88.130.200.110) has joined #ceph
[5:45] * onyb (~ani07nov@119.82.105.66) has joined #ceph
[5:48] * Vacuum__ (~Vacuum@88.130.193.2) Quit (Ping timeout: 480 seconds)
[5:54] * [0x4A6F]_ (~ident@p4FC262CB.dip0.t-ipconnect.de) has joined #ceph
[6:01] * [0x4A6F] (~ident@0x4a6f.user.oftc.net) Quit (Ping timeout: 480 seconds)
[6:01] * [0x4A6F]_ is now known as [0x4A6F]
[6:04] * xarses_ is now known as xarses
[6:05] * wjw-freebsd (~wjw@smtp.digiware.nl) Quit (Ping timeout: 480 seconds)
[6:05] * BrianA (~BrianA@c-24-130-77-245.hsd1.ca.comcast.net) Quit (Read error: Connection reset by peer)
[6:12] * EinstCrazy (~EinstCraz@58.247.117.134) Quit (Remote host closed the connection)
[6:28] * kuku (~kuku@119.93.91.136) Quit (Ping timeout: 480 seconds)
[6:30] * kuku (~kuku@119.93.91.136) has joined #ceph
[6:35] * rraja (~rraja@121.244.87.117) has joined #ceph
[6:42] * kefu (~kefu@45.32.49.168) has joined #ceph
[6:44] * vikhyat (~vumrao@121.244.87.116) has joined #ceph
[6:44] * moon (~moon@tunnel.greenhost.nl) has joined #ceph
[6:52] * ffilzwin (~ffilz@c-76-115-190-27.hsd1.or.comcast.net) Quit (Read error: Connection reset by peer)
[6:52] * ffilzwin (~ffilz@c-76-115-190-27.hsd1.or.comcast.net) has joined #ceph
[6:57] * vikhyat (~vumrao@121.244.87.116) Quit (Quit: Leaving)
[7:01] * BrianA (~BrianA@c-24-130-77-245.hsd1.ca.comcast.net) has joined #ceph
[7:02] * swami1 (~swami@49.38.1.205) has joined #ceph
[7:02] * Ralth (~xENO_@213.61.149.100) has joined #ceph
[7:11] * react (~react@2001:4800:7815:103:f0d7:c55:ff05:60e8) Quit (Quit: ZNC 1.7.x-git-195-a314d30 - http://znc.in)
[7:11] * react (~react@retard.io) has joined #ceph
[7:23] * rotbeard (~redbeard@185.32.80.238) has joined #ceph
[7:28] * xarses_ (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) has joined #ceph
[7:28] * xarses_ (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) Quit (Remote host closed the connection)
[7:29] * xarses_ (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) has joined #ceph
[7:29] * moon (~moon@tunnel.greenhost.nl) Quit (Ping timeout: 480 seconds)
[7:29] * xarses (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) Quit (Read error: Connection reset by peer)
[7:31] * nils_ (~nils_@doomstreet.collins.kg) has joined #ceph
[7:32] * Ralth (~xENO_@7V7AAG2FG.tor-irc.dnsbl.oftc.net) Quit ()
[7:32] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[7:37] * itamarl is now known as Guest1919
[7:37] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[7:38] * BrianA (~BrianA@c-24-130-77-245.hsd1.ca.comcast.net) Quit (Read error: Connection reset by peer)
[7:38] * moon (~moon@217-19-26-201.dsl.cambrium.nl) has joined #ceph
[7:40] * wes_dillingham (~wes_dilli@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) Quit (Quit: wes_dillingham)
[7:40] * Guest1919 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[7:41] * xarses_ (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) Quit (Read error: Connection reset by peer)
[7:41] * xarses (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) has joined #ceph
[7:42] * xarses (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) Quit (Remote host closed the connection)
[7:42] * xarses (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) has joined #ceph
[7:50] * itamarl is now known as Guest1921
[7:50] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[7:50] * karnan (~karnan@121.244.87.117) has joined #ceph
[7:52] * gauravbafna (~gauravbaf@49.38.0.134) has joined #ceph
[7:54] * Guest1921 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[7:57] * fc (~fredrik@blue.fsck.se) has joined #ceph
[7:58] * itamarl is now known as Guest1923
[7:58] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[7:59] <fc> Hi, I have 2 osd-server with 36 disks in each, every other time i reboot my drives change letters /dev/sdx and break my osds, do you guyes use UUID to create your clusters?
[8:00] * Guest1923 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[8:00] <fc> or it's the journal for each osd (that is on ssd) that don't work.
[8:03] * EinstCrazy (~EinstCraz@58.247.117.134) has joined #ceph
[8:06] * ffilzwin (~ffilz@c-76-115-190-27.hsd1.or.comcast.net) Quit (Read error: Connection reset by peer)
[8:07] * itamarl is now known as Guest1924
[8:07] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[8:08] * ffilzwin (~ffilz@c-76-115-190-27.hsd1.or.comcast.net) has joined #ceph
[8:09] * kawa2014 (~kawa@89.184.114.246) has joined #ceph
[8:10] * Guest1924 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[8:10] <koszik> fc, yes, it's best practice anyway to use uuids as device names are not persistent
[8:11] * moon (~moon@217-19-26-201.dsl.cambrium.nl) Quit (Ping timeout: 480 seconds)
[8:12] * itamarl is now known as Guest1926
[8:12] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[8:14] * kefu (~kefu@45.32.49.168) Quit (Remote host closed the connection)
[8:14] * kefu (~kefu@45.32.49.168) has joined #ceph
[8:15] * MentalRay (~MentalRay@LPRRPQ1401W-LP130-02-1242363207.dsl.bell.ca) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[8:15] * Guest1926 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[8:18] * itamarl is now known as Guest1927
[8:18] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[8:20] * Guest1927 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[8:21] * moon (~moon@217-19-26-201.dsl.cambrium.nl) has joined #ceph
[8:25] * itamarl is now known as Guest1928
[8:25] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[8:26] * sickology (~mio@vpn.bcs.hr) Quit (Read error: Connection reset by peer)
[8:26] * sickology (~mio@vpn.bcs.hr) has joined #ceph
[8:26] * tserong (~tserong@203-214-92-220.dyn.iinet.net.au) Quit (Quit: Leaving)
[8:28] * Guest1928 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[8:30] * itamarl is now known as Guest1930
[8:30] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[8:31] * pdrakewe_ (~pdrakeweb@cpe-71-74-153-111.neo.res.rr.com) has joined #ceph
[8:33] * Guest1930 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[8:35] * pdrakeweb (~pdrakeweb@cpe-71-74-153-111.neo.res.rr.com) Quit (Ping timeout: 480 seconds)
[8:37] * itamarl is now known as Guest1932
[8:37] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[8:37] * vikhyat (~vumrao@121.244.87.116) has joined #ceph
[8:37] * shylesh (~shylesh@121.244.87.118) has joined #ceph
[8:38] * Guest1932 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[8:39] * derjohn_mob (~aj@p578b6aa1.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[8:39] * toMeloos (~toMeloos@53568B3D.cm-6-7c.dynamic.ziggo.nl) has joined #ceph
[8:42] * itamarl is now known as Guest1933
[8:42] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[8:45] * Guest1933 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[8:46] * itamarl is now known as Guest1934
[8:46] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[8:47] * onyb (~ani07nov@119.82.105.66) Quit (Quit: raise SystemExit())
[8:50] * toMeloos (~toMeloos@53568B3D.cm-6-7c.dynamic.ziggo.nl) Quit (Ping timeout: 480 seconds)
[8:50] * Guest1934 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[9:01] * moon (~moon@217-19-26-201.dsl.cambrium.nl) Quit (Ping timeout: 480 seconds)
[9:02] * aakso (aakso@hauki.tunkki.fi) Quit (Read error: Connection reset by peer)
[9:02] * aakso (aakso@hauki.tunkki.fi) has joined #ceph
[9:03] * huangjun (~kvirc@113.57.168.154) Quit (Ping timeout: 480 seconds)
[9:04] * psiekl (psiekl@wombat.eu.org) Quit (Remote host closed the connection)
[9:04] * psiekl (psiekl@wombat.eu.org) has joined #ceph
[9:06] * ade (~abradshaw@dslb-188-102-071-182.188.102.pools.vodafone-ip.de) has joined #ceph
[9:07] * ade (~abradshaw@dslb-188-102-071-182.188.102.pools.vodafone-ip.de) Quit ()
[9:07] * ade (~abradshaw@dslb-188-102-071-182.188.102.pools.vodafone-ip.de) has joined #ceph
[9:07] * itamarl is now known as Guest1935
[9:07] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[9:10] * huangjun (~kvirc@113.57.168.154) has joined #ceph
[9:10] * analbeard (~shw@support.memset.com) has joined #ceph
[9:11] * Guest1935 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[9:14] * mewald (~Adium@185.80.187.212) has joined #ceph
[9:15] * itamarl is now known as Guest1936
[9:15] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[9:15] * rdas (~rdas@121.244.87.116) has joined #ceph
[9:17] * Guest1936 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[9:18] * itamarl is now known as Guest1938
[9:18] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[9:19] * mewald (~Adium@185.80.187.212) has left #ceph
[9:20] * tserong (~tserong@203-214-92-220.dyn.iinet.net.au) has joined #ceph
[9:21] * Foysal (~Foysal@202.84.42.5) Quit (Ping timeout: 480 seconds)
[9:23] * Guest1938 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[9:23] <singler> fc: I never had problem with disk letters. Do you have separate journals? How did you setup your OSDs?
[9:25] * adrian (~abradshaw@dslb-188-102-071-182.188.102.pools.vodafone-ip.de) has joined #ceph
[9:26] * adrian is now known as Guest1939
[9:28] * itamarl is now known as Guest1940
[9:28] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[9:29] <IcePic> singler: depending on luck or bad luck, disks could report in to the kernel while being probe in different order, most easily visible if you have a lot of usb sticks on hubs and so on, but probably possible for other disks and controllers too
[9:29] <IcePic> probed*
[9:29] * Guest1939 (~abradshaw@dslb-188-102-071-182.188.102.pools.vodafone-ip.de) Quit ()
[9:30] * derjohn_mob (~aj@46.189.28.41) has joined #ceph
[9:30] * Maariu5_ (~thundercl@ns316491.ip-37-187-129.eu) has joined #ceph
[9:31] * Guest1940 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[9:32] * ade_b (~abradshaw@dslb-188-102-071-182.188.102.pools.vodafone-ip.de) has joined #ceph
[9:32] * ade (~abradshaw@dslb-188-102-071-182.188.102.pools.vodafone-ip.de) Quit (Quit: Too sexy for his shirt)
[9:32] * brians__ (~brian@80.111.114.175) Quit (Max SendQ exceeded)
[9:32] * ade_b (~abradshaw@dslb-188-102-071-182.188.102.pools.vodafone-ip.de) Quit ()
[9:32] * ade (~abradshaw@dslb-188-102-071-182.188.102.pools.vodafone-ip.de) has joined #ceph
[9:33] * itamarl is now known as Guest1941
[9:33] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[9:33] <singler> I ment that I had no problems with changed letters. There were situations when letters changed for me (e.g. one disk died and I was rebooting server), but I never had problems with it. It just worked
[9:33] * brians (~brian@80.111.114.175) has joined #ceph
[9:35] * rendar (~I@host45-183-dynamic.49-79-r.retail.telecomitalia.it) has joined #ceph
[9:36] * Guest1941 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[9:36] * bvi (~Bastiaan@185.56.32.1) has joined #ceph
[9:37] * itamarl is now known as Guest1942
[9:37] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[9:38] * brians (~brian@80.111.114.175) Quit (Max SendQ exceeded)
[9:39] * mewald1 (~Adium@185.80.187.212) has joined #ceph
[9:41] * brians (~brian@80.111.114.175) has joined #ceph
[9:41] * Guest1942 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[9:42] * itamarl is now known as Guest1943
[9:42] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[9:42] <IcePic> if they probe out of order, then what was sde last time, would be sdf now, so using uuids is most certainly a good idea whenever you can.
[9:43] <fc> singler, i create my osd with ceph-deploy and I have journal on SSD's. The letters all shuffled when a drive failed, but they changed back to their original value after another reboot, and now it seems a little random if they change or not (these are 36 slotts chassis with 4 ssds)
[9:45] * Guest1943 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[9:48] * kuku (~kuku@119.93.91.136) Quit (Ping timeout: 480 seconds)
[9:48] * itamarl is now known as Guest1944
[9:48] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[9:50] * Guest1944 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[9:51] * kefu is now known as kefu|afk
[9:53] * EinstCrazy (~EinstCraz@58.247.117.134) Quit (Remote host closed the connection)
[9:53] * allaok (~allaok@machine107.orange-labs.com) has joined #ceph
[9:54] * itamarl is now known as Guest1945
[9:54] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[9:54] * brians (~brian@80.111.114.175) Quit (Ping timeout: 480 seconds)
[9:56] * EinstCrazy (~EinstCraz@58.247.117.134) has joined #ceph
[9:56] * Guest1945 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[9:58] * kefu|afk is now known as kefu
[9:59] * itamarl is now known as Guest1946
[9:59] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[10:00] * kuku (~kuku@119.93.91.136) has joined #ceph
[10:00] * Maariu5_ (~thundercl@7V7AAG2JQ.tor-irc.dnsbl.oftc.net) Quit ()
[10:01] * kefu (~kefu@45.32.49.168) Quit (Remote host closed the connection)
[10:01] * onyb (~ani07nov@119.82.105.66) has joined #ceph
[10:02] * onyb (~ani07nov@119.82.105.66) Quit ()
[10:02] * Guest1946 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[10:02] * kefu (~kefu@114.92.118.31) has joined #ceph
[10:04] * kuku (~kuku@119.93.91.136) Quit (Remote host closed the connection)
[10:04] * itamarl is now known as Guest1947
[10:04] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[10:04] * evelu (~erwan@2a01:e34:eecb:7400:4eeb:42ff:fedc:8ac) has joined #ceph
[10:08] * Guest1947 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[10:08] * allaok (~allaok@machine107.orange-labs.com) has left #ceph
[10:08] * ifur (~osm@hornbill.csc.warwick.ac.uk) has joined #ceph
[10:09] * ifur_ (~osm@hornbill.csc.warwick.ac.uk) Quit (Ping timeout: 480 seconds)
[10:12] * itamarl is now known as Guest1950
[10:12] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[10:13] * dgurtner (~dgurtner@84-73-130-19.dclient.hispeed.ch) has joined #ceph
[10:14] * Guest1950 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[10:15] * evelu (~erwan@2a01:e34:eecb:7400:4eeb:42ff:fedc:8ac) Quit (Ping timeout: 480 seconds)
[10:16] * ifur (~osm@0001f63e.user.oftc.net) Quit (Ping timeout: 480 seconds)
[10:22] * ifur (~osm@hornbill.csc.warwick.ac.uk) has joined #ceph
[10:25] * itamarl is now known as Guest1951
[10:25] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[10:26] * toMeloos (~toMeloos@2a03:fc02:2:1:9eeb:e8ff:fe06:cfbb) has joined #ceph
[10:29] * Guest1951 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[10:30] * itamarl is now known as Guest1954
[10:30] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[10:33] * Guest1954 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[10:33] * itamarl is now known as Guest1958
[10:34] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[10:36] * zapu (~Knuckx@213.61.149.100) has joined #ceph
[10:38] * Guest1958 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[10:41] * itamarl is now known as Guest1960
[10:42] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[10:43] * yanzheng (~zhyan@125.70.20.240) Quit (Read error: Connection reset by peer)
[10:43] * T1w (~jens@node3.survey-it.dk) has joined #ceph
[10:44] * Guest1960 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[10:46] * ifur_ (~osm@hornbill.csc.warwick.ac.uk) has joined #ceph
[10:47] * itamarl is now known as Guest1961
[10:47] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[10:47] * TMM (~hp@185.5.121.201) has joined #ceph
[10:48] * ngoswami (~ngoswami@1.39.15.161) has joined #ceph
[10:48] * ifur (~osm@0001f63e.user.oftc.net) Quit (Ping timeout: 480 seconds)
[10:50] * Guest1961 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[10:53] * itamarl is now known as Guest1963
[10:53] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[10:55] * Guest1963 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[10:59] * ChengPeng (~chris@180.168.126.179) Quit (Quit: Leaving)
[10:59] * yanzheng (~zhyan@125.70.20.240) has joined #ceph
[11:00] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:9901:29b4:b6c5:3fa9) has joined #ceph
[11:02] * itamarl is now known as Guest1964
[11:02] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[11:03] * EinstCrazy (~EinstCraz@58.247.117.134) Quit (Remote host closed the connection)
[11:03] * EinstCrazy (~EinstCraz@58.247.117.134) has joined #ceph
[11:05] * Guest1964 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[11:06] * zapu (~Knuckx@06SAAEUY6.tor-irc.dnsbl.oftc.net) Quit ()
[11:07] * itamarl is now known as Guest1965
[11:07] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[11:08] * bjornar_ (~bjornar@109.247.131.38) has joined #ceph
[11:10] * dvanders (~dvanders@2001:1458:202:225::101:124a) has joined #ceph
[11:11] * Guest1965 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[11:12] * ifur (~osm@0001f63e.user.oftc.net) has joined #ceph
[11:12] * dvanders (~dvanders@2001:1458:202:225::101:124a) Quit (Remote host closed the connection)
[11:14] * ifur_ (~osm@hornbill.csc.warwick.ac.uk) Quit (Ping timeout: 480 seconds)
[11:15] * Aal (~rcfighter@de2x.mullvad.net) has joined #ceph
[11:16] * chengpeng (~chengpeng@180.168.170.2) has joined #ceph
[11:16] * chengpeng (~chengpeng@180.168.170.2) has left #ceph
[11:17] * itamarl is now known as Guest1968
[11:18] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[11:19] * Guest1968 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[11:19] * EinstCra_ (~EinstCraz@58.247.117.134) has joined #ceph
[11:20] * chengpeng (~chengpeng@180.168.197.98) has joined #ceph
[11:20] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:9901:29b4:b6c5:3fa9) Quit (Ping timeout: 480 seconds)
[11:23] * itamarl is now known as Guest1969
[11:23] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[11:23] <chengpeng> DCC CHAT badone
[11:26] * Guest1969 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[11:26] * EinstCrazy (~EinstCraz@58.247.117.134) Quit (Ping timeout: 480 seconds)
[11:27] <badone> chengpeng: I have no idea what that is?
[11:28] <badone> what are you trying to send me and why?
[11:28] * MaZ- (~maz@00016955.user.oftc.net) has joined #ceph
[11:29] * itamarl is now known as Guest1970
[11:29] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[11:29] <MaZ-> correct me if i'm wrong... but it looks like https://github.com/ceph/ceph/pull/9974/files - means that prior to this fix, ceph rgw replications was not cleaning up the data it was sending to the remote endpoint, and this was staying in memory?
[11:30] <MaZ-> because if so that would very much explain why i was seeing RadosGW processes using 80+GB of RSS within 20 minutes
[11:30] <badone> chengpeng: afraid not but there will be others on the list that can help, just ask your questions
[11:31] * Guest1970 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[11:34] * chengpeng (~chengpeng@180.168.197.98) has left #ceph
[11:34] * itamarl is now known as Guest1971
[11:34] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[11:35] * Chris_ke (~ke@180.168.170.2) has joined #ceph
[11:36] * Aal (~rcfighter@de2x.mullvad.net) Quit (Ping timeout: 480 seconds)
[11:37] * Guest1971 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[11:38] * ceph-ircslackbot (~ceph-ircs@ds9536.dreamservers.com) Quit (Remote host closed the connection)
[11:38] * ceph-ircslackbot (~ceph-ircs@ds9536.dreamservers.com) has joined #ceph
[11:40] * itamarl is now known as Guest1972
[11:40] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[11:42] <IcePic> badone: dcc chat is like pm, except it tries to connect directly to (what the irc client think is) your ip and bypass the irc network for private conversation. Has obvious issues with nat (at both ends) of course.
[11:42] <IcePic> pm == /msg of course
[11:42] * Guest1972 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[11:45] * evelu (~erwan@2a01:e34:eecb:7400:4eeb:42ff:fedc:8ac) has joined #ceph
[11:46] * kefu (~kefu@114.92.118.31) Quit (Max SendQ exceeded)
[11:46] * kefu (~kefu@114.92.118.31) has joined #ceph
[11:49] * poller (~Cue@tor2r.ins.tor.net.eu.org) has joined #ceph
[11:49] * jcsp (~jspray@82-71-16-249.dsl.in-addr.zen.co.uk) Quit (Quit: Ex-Chat)
[11:51] * kefu (~kefu@114.92.118.31) Quit (Max SendQ exceeded)
[11:51] * kefu (~kefu@114.92.118.31) has joined #ceph
[11:53] * nass5 (~fred@194.199.223.12) Quit (Quit: Leaving.)
[11:53] * nass5 (~fred@l-p-dn-in-12a.lionnois.site.univ-lorraine.fr) has joined #ceph
[11:54] * itamarl is now known as Guest1974
[11:54] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[11:56] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:9901:29b4:b6c5:3fa9) has joined #ceph
[11:57] * Guest1974 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[11:57] * brians (~brian@80.111.114.175) has joined #ceph
[11:57] * brians (~brian@80.111.114.175) Quit (Max SendQ exceeded)
[11:58] <badone> IcePic: I have no use for that
[11:58] * brians (~brian@80.111.114.175) has joined #ceph
[12:00] * itamarl is now known as Guest1975
[12:00] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[12:02] * EinstCrazy (~EinstCraz@60-249-152-164.HINET-IP.hinet.net) has joined #ceph
[12:02] * Guest1975 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[12:06] * itamarl is now known as Guest1976
[12:06] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[12:08] * EinstCra_ (~EinstCraz@58.247.117.134) Quit (Ping timeout: 480 seconds)
[12:10] * Guest1976 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[12:11] * itamarl is now known as Guest1977
[12:11] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[12:14] * Guest1977 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[12:15] * itamarl is now known as Guest1978
[12:15] * swami1 (~swami@49.38.1.205) Quit (Read error: Connection reset by peer)
[12:15] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[12:15] * wjw-freebsd (~wjw@smtp.digiware.nl) has joined #ceph
[12:19] * poller (~Cue@7V7AAG2NP.tor-irc.dnsbl.oftc.net) Quit ()
[12:19] * itamarl is now known as Guest1981
[12:19] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[12:19] * Guest1978 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[12:23] * realitysandwich (~perry@2001:920:1846:1dc0:4e34:88ff:fef5:3304) has joined #ceph
[12:23] * Guest1981 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[12:24] * mewald1 (~Adium@185.80.187.212) Quit (Quit: Leaving.)
[12:26] * shyu (~Frank@218.241.172.114) has joined #ceph
[12:27] * itamarl is now known as Guest1982
[12:27] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[12:27] * jcsp (~jspray@fpc101952-sgyl38-2-0-cust21.18-2.static.cable.virginm.net) has joined #ceph
[12:27] * mewald (~Adium@185.80.187.212) has joined #ceph
[12:29] * Guest1982 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[12:30] * evelu (~erwan@2a01:e34:eecb:7400:4eeb:42ff:fedc:8ac) Quit (Ping timeout: 480 seconds)
[12:33] * EinstCrazy (~EinstCraz@60-249-152-164.HINET-IP.hinet.net) Quit (Remote host closed the connection)
[12:36] * itamarl is now known as Guest1984
[12:36] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[12:40] * Guest1984 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[12:41] * itamarl is now known as Guest1985
[12:41] * wjw-freebsd (~wjw@smtp.digiware.nl) Quit (Ping timeout: 480 seconds)
[12:41] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[12:42] * Hemanth (~hkumar_@103.228.221.137) has joined #ceph
[12:44] * Guest1985 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[12:46] * itamarl is now known as Guest1986
[12:46] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[12:46] * dgurtner (~dgurtner@84-73-130-19.dclient.hispeed.ch) Quit (Ping timeout: 480 seconds)
[12:47] <realitysandwich> any idea why when I am writing data to my ceph pool, one osd per server (3 machines total with 7 osds each) will have about 50% total usage according to iostat while the rest are around 2%?
[12:49] * Guest1986 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[12:50] * itamarl is now known as Guest1987
[12:50] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[12:50] * clarjon1 (~dotblank@ns316491.ip-37-187-129.eu) has joined #ceph
[12:51] * evelu (~erwan@2a01:e34:eecb:7400:4eeb:42ff:fedc:8ac) has joined #ceph
[12:54] * Guest1987 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[12:58] * itamarl is now known as Guest1988
[12:58] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[13:00] * realitysandwich (~perry@2001:920:1846:1dc0:4e34:88ff:fef5:3304) Quit (Quit: WeeChat 1.5)
[13:01] * Guest1988 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[13:02] * itamarl is now known as Guest1990
[13:02] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[13:04] * huangjun (~kvirc@113.57.168.154) Quit (Ping timeout: 480 seconds)
[13:05] <flaf> Hi, during the upgrade according to the doc http://docs.ceph.com/docs/firefly/install/upgrading-ceph/#upgrading-ceph, it's better to follow this order: upgrade mon, osd, msd and radosgw. Ok with that but what about the client side? Is it better to upgrade clients _before_ the cluster, or _after_?
[13:05] * vicente (~~vicente@125-227-238-55.HINET-IP.hinet.net) Quit (Quit: Leaving)
[13:06] * Guest1990 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[13:06] <vikhyat> flaf: yes you should upgrade the clients also
[13:07] <vikhyat> if you are not changing tunables then you can choose any path
[13:07] <etienneme> It probably depends of your tunable.
[13:07] <vikhyat> but if you are changing tunable then it is better to upgrade the clients first
[13:07] <etienneme> be careful, "optimal" can change the tunable.
[13:07] * Be-El (~blinke@nat-router.computational.bio.uni-giessen.de) has joined #ceph
[13:08] * itamarl is now known as Guest1991
[13:08] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[13:08] <etienneme> What version do you have and do you aim?
[13:09] <flaf> So if I understand well, I can upgrade the cluster, don't change tunables, then upgrade all the clients and then change tunables, correct ?
[13:10] * hellertime (~Adium@72.246.3.14) has joined #ceph
[13:10] * Guest1991 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[13:10] <flaf> etienneme: it's a generic question but I'm using jewel currently.
[13:10] <etienneme> Ok
[13:11] <etienneme> Yes
[13:11] <etienneme> When you will change tunable you can have some rebalance.
[13:11] <etienneme> http://docs.ceph.com/docs/master/rados/operations/crush-map/#jewel-crush-tunables5
[13:12] <etienneme> You'll always find what you need to know before changing tunable.
[13:12] <flaf> Yes, I think I'm ok with that (I have commited and fixed this page ;)).
[13:12] <etienneme> ;)
[13:13] * itamarl is now known as Guest1992
[13:13] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[13:14] <flaf> But I'd like to find doc talking about the order in a upgrade and especially concerning the clients side.
[13:15] <flaf> I can find doc concerning the order in cluster side but the client side is never explained (or maybe I have missed a page).
[13:16] * Guest1992 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[13:16] * gauravba_ (~gauravbaf@49.32.28.22) has joined #ceph
[13:18] * Raboo (~raboo@nl-ams-ubnt01.letit.se) has joined #ceph
[13:18] * itamarl is now known as Guest1993
[13:18] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[13:20] * clarjon1 (~dotblank@06SAAEU20.tor-irc.dnsbl.oftc.net) Quit ()
[13:20] <flaf> Anyway thx etienneme and vikhyat for your help. ;)
[13:21] <vikhyat> flaf: _o/ btw there is no client side page
[13:21] * Guest1993 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[13:21] <vikhyat> if I remember correct
[13:21] * gauravbafna (~gauravbaf@49.38.0.134) Quit (Ping timeout: 480 seconds)
[13:26] <flaf> by the way, here it's very confusing http://docs.ceph.com/docs/firefly/install/upgrading-ceph/#upgrading-ceph => ???1. Ceph Monitors (or Ceph OSD Daemons) 2. Ceph OSD Daemons (or Ceph Monitors)???. Wtf?? ;)
[13:27] <flaf> Oh sorry, my link is old (firefly).
[13:28] <flaf> http://docs.ceph.com/docs/master/install/upgrading-ceph/#summary <= it's fixed here. Sorry for the noise.
[13:28] <etienneme> Google ofently an old version of the doc :(
[13:28] <etienneme> gives*
[13:28] <flaf> Yes indeed.
[13:33] * huangjun (~kvirc@117.151.50.153) has joined #ceph
[13:35] * hellertime (~Adium@72.246.3.14) Quit (Quit: Leaving.)
[13:35] * hellertime (~Adium@a72-246-0-10.deploy.akamaitechnologies.com) has joined #ceph
[13:36] * hellertime (~Adium@a72-246-0-10.deploy.akamaitechnologies.com) has left #ceph
[13:38] * itamarl is now known as Guest1995
[13:38] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[13:40] * evelu (~erwan@2a01:e34:eecb:7400:4eeb:42ff:fedc:8ac) Quit (Ping timeout: 480 seconds)
[13:41] * Guest1995 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[13:43] * itamarl is now known as Guest1996
[13:43] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[13:45] * ira (~ira@c-24-34-255-34.hsd1.ma.comcast.net) has joined #ceph
[13:46] * Guest1996 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[13:49] * itamarl is now known as Guest1997
[13:49] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[13:50] <TheSov> I was asking yesterday if its normal to have objects in a pool that doesnt have any images in it, does anyone have the answer to that? and is there a way to clean up orphaned objects?
[13:50] * sickology (~mio@vpn.bcs.hr) Quit (Ping timeout: 480 seconds)
[13:51] * Guest1997 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[13:52] * evelu (~erwan@37.162.138.103) has joined #ceph
[13:57] <Raboo> I'm trying to start docker ceph/daemon osd with the type activate, and I specify OSD_DEVICE=/dev/sda1.
[13:57] <Raboo> The container starts, then it dies
[13:57] * itamarl is now known as Guest1998
[13:57] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[13:57] * shyu (~Frank@218.241.172.114) Quit (Ping timeout: 480 seconds)
[13:57] * georgem (~Adium@24.114.56.189) has joined #ceph
[13:57] <Raboo> im pretty sure this worked before? has the TYPE=activate changed so you need to specify OSD_DEVICE=/dev/sda instead of sda1?
[13:57] * georgem (~Adium@24.114.56.189) Quit ()
[13:58] * georgem (~Adium@206.108.127.16) has joined #ceph
[13:59] * dgurtner (~dgurtner@84-73-130-19.dclient.hispeed.ch) has joined #ceph
[14:00] * dugravot6 (~dugravot6@l-p-dn-in-4a.lionnois.site.univ-lorraine.fr) has joined #ceph
[14:01] * Guest1998 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[14:03] * itamarl is now known as Guest2000
[14:03] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[14:04] * neurodrone (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) has joined #ceph
[14:05] * Guest2000 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[14:06] * jmn (~jmn@nat-pool-bos-t.redhat.com) Quit (Quit: Coyote finally caught me)
[14:07] * bniver (~bniver@nat-pool-bos-u.redhat.com) has joined #ceph
[14:08] * itamarl is now known as Guest2002
[14:08] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[14:11] * Guest2002 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[14:11] * karnan (~karnan@121.244.87.117) Quit (Ping timeout: 480 seconds)
[14:11] * itamarl is now known as Guest2004
[14:12] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[14:14] * madkiss (~madkiss@2001:6f8:12c3:f00f:586e:fbca:9eb1:4ebb) Quit (Quit: Leaving.)
[14:16] * Guest2004 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[14:16] * sickology (~mio@vpn.bcs.hr) has joined #ceph
[14:18] * itamarl is now known as Guest2006
[14:18] * garphy is now known as garphy`aw
[14:18] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[14:21] * karnan (~karnan@121.244.87.117) has joined #ceph
[14:22] * itamarl is now known as Guest2007
[14:22] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[14:22] * Guest2006 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[14:22] * jcsp (~jspray@fpc101952-sgyl38-2-0-cust21.18-2.static.cable.virginm.net) Quit (Ping timeout: 480 seconds)
[14:23] * dneary (~dneary@nat-pool-bos-u.redhat.com) has joined #ceph
[14:25] <Raboo> isn't there one ceph docker osd TYPE to prepare/zap disk if not prepared, and skip the prepare if it is prepared
[14:26] * jarrpa (~jarrpa@2602:3f:e183:a600:eab1:fcff:fe47:f680) has joined #ceph
[14:26] * Guest2007 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[14:28] * itamarl is now known as Guest2008
[14:28] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[14:30] * Guest2008 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[14:30] * garphy`aw is now known as garphy
[14:32] <TheSov> raboo im sure you can script that before u run the docker image
[14:33] <The_Ball> I'm trying to get calamari up and running. I've setup a Ubuntu VM as the calamari server as that's the only prebuilt packages I could find. Server is up and running and I can get salt-minions enrolled, but "no cluster defined". When I try a manual salt call to check ceph heartbeat I get "no module ceph". I'm wondering if the wrong salt-minion package has been installed on the nodes perhaps, or what else would provide the "salt ceph module"?
[14:33] * ccourtaut (~ccourtaut@178.62.125.124) Quit (Ping timeout: 480 seconds)
[14:34] * itamarl is now known as Guest2009
[14:35] * percevalbot (~supybot@pct-empresas-82.uc3m.es) has joined #ceph
[14:35] * georgem (~Adium@206.108.127.16) Quit (Quit: Leaving.)
[14:35] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[14:36] * Guest2009 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[14:40] <Raboo> TheSov it's almost already done in ceph docker
[14:40] <Raboo> if [[ "$(parted --script ${OSD_DEVICE} print | egrep '^ 1.*ceph data')" && ${OSD_FORCE_ZAP} -ne "1" ]]; then
[14:40] * itamarl is now known as Guest2011
[14:40] <Raboo> instead of a exit 1, there could be a return
[14:41] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[14:43] * jcsp (~jspray@82-71-16-249.dsl.in-addr.zen.co.uk) has joined #ceph
[14:44] * Guest2011 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[14:47] * itamarl is now known as Guest2013
[14:47] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[14:51] * Guest2013 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[14:54] * mhack (~mhack@2604:6000:8d40:9400::5) has joined #ceph
[14:54] <Raboo> ohh, this might work if I don't specify a TYPE
[14:55] * georgem (~Adium@206.108.127.16) has joined #ceph
[14:57] * itamarl is now known as Guest2015
[14:57] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[15:01] * Guest2015 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[15:01] * itamarl is now known as Guest2017
[15:01] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[15:04] * neurodrone (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) Quit (Quit: neurodrone)
[15:05] * Guest2017 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[15:06] * brad_mssw (~brad@66.129.88.50) has joined #ceph
[15:08] * Bwana (~raindog@tor2r.ins.tor.net.eu.org) has joined #ceph
[15:09] * itamarl is now known as Guest2018
[15:09] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[15:11] * sebastian-w_ (~quassel@212.218.8.139) Quit (Remote host closed the connection)
[15:11] * sebastian-w (~quassel@212.218.8.138) has joined #ceph
[15:11] * tserong (~tserong@203-214-92-220.dyn.iinet.net.au) Quit (Ping timeout: 480 seconds)
[15:12] * Guest2018 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[15:12] * tserong (~tserong@203-214-92-220.dyn.iinet.net.au) has joined #ceph
[15:14] * jdillaman (~jdillaman@h187.196.31.71.dynamic.ip.windstream.net) has joined #ceph
[15:21] * itamarl is now known as Guest2019
[15:21] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[15:22] * garphy is now known as garphy`aw
[15:22] * penguinRaider (~KiKo@69.163.33.182) Quit (Ping timeout: 480 seconds)
[15:23] * dyasny (~dyasny@cable-192.222.152.136.electronicbox.net) has joined #ceph
[15:24] * mattbenjamin (~mbenjamin@76-206-42-50.lightspeed.livnmi.sbcglobal.net) has joined #ceph
[15:26] * Guest2019 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[15:30] * rotbeard (~redbeard@185.32.80.238) Quit (Quit: Leaving)
[15:30] <Raboo> leseb docker ceph/daemon with tag jewel fails to build..
[15:32] * ccourtaut (~ccourtaut@157.173.31.93.rev.sfr.net) has joined #ceph
[15:33] * itamarl is now known as Guest2021
[15:33] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[15:34] * garphy`aw is now known as garphy
[15:36] * Guest2021 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[15:38] * rwheeler (~rwheeler@nat-pool-bos-t.redhat.com) has joined #ceph
[15:38] * gauravba_ (~gauravbaf@49.32.28.22) Quit (Ping timeout: 480 seconds)
[15:38] * Bwana (~raindog@4MJAAHFKX.tor-irc.dnsbl.oftc.net) Quit ()
[15:38] * penguinRaider (~KiKo@14.139.82.6) has joined #ceph
[15:39] * Brochacho (~alberto@c-50-141-135-98.hsd1.il.comcast.net) has joined #ceph
[15:40] * itamarl is now known as Guest2024
[15:40] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[15:41] * Guest2024 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[15:42] * toMeloos (~toMeloos@2a03:fc02:2:1:9eeb:e8ff:fe06:cfbb) Quit (Ping timeout: 480 seconds)
[15:42] * jmn (~jmn@nat-pool-bos-t.redhat.com) has joined #ceph
[15:42] * wes_dillingham (~wes_dilli@140.247.242.44) has joined #ceph
[15:43] <leseb> Raboo please open an issue, I'll have a look later
[15:45] * itamarl is now known as Guest2025
[15:45] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[15:45] <Raboo> leseb ok
[15:45] <leseb> Raboo thanks
[15:46] * TMM (~hp@185.5.121.201) Quit (Remote host closed the connection)
[15:47] * mattbenjamin (~mbenjamin@76-206-42-50.lightspeed.livnmi.sbcglobal.net) Quit (Quit: Leaving.)
[15:47] * Hemanth (~hkumar_@103.228.221.137) Quit (Ping timeout: 480 seconds)
[15:47] * ngoswami (~ngoswami@1.39.15.161) Quit (Quit: This computer has gone to sleep)
[15:48] * Guest2025 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[15:49] * TMM (~hp@185.5.121.201) has joined #ceph
[15:51] * yanzheng (~zhyan@125.70.20.240) Quit (Quit: This computer has gone to sleep)
[15:52] * itamarl is now known as Guest2027
[15:52] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[15:53] * Guest2027 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[15:55] * Hemanth (~hkumar_@103.228.221.137) has joined #ceph
[15:56] * xarses (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[15:58] * dnunez (~dnunez@nat-pool-bos-t.redhat.com) has joined #ceph
[15:59] * Racpatel (~Racpatel@2601:87:0:24af::4c8f) has joined #ceph
[16:02] * T1w (~jens@node3.survey-it.dk) Quit (Ping timeout: 480 seconds)
[16:03] * itamarl is now known as Guest2028
[16:03] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[16:05] * kawa2014 (~kawa@89.184.114.246) Quit (Ping timeout: 480 seconds)
[16:05] * kawa2014 (~kawa@212.110.41.244) has joined #ceph
[16:06] * karnan (~karnan@121.244.87.117) Quit (Ping timeout: 480 seconds)
[16:06] * rotbeard (~redbeard@185.32.80.238) has joined #ceph
[16:07] * Guest2028 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[16:08] * neurodrone (~neurodron@158.106.193.162) has joined #ceph
[16:11] * ngoswami (~ngoswami@1.39.15.161) has joined #ceph
[16:11] * ngoswami (~ngoswami@1.39.15.161) Quit ()
[16:11] * itamarl is now known as Guest2029
[16:11] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[16:12] * ngoswami (~ngoswami@1.39.15.161) has joined #ceph
[16:12] * ngoswami (~ngoswami@1.39.15.161) Quit ()
[16:12] * DV_ (~veillard@2001:41d0:a:f29f::1) Quit (Ping timeout: 480 seconds)
[16:13] * ngoswami (~ngoswami@1.39.15.161) has joined #ceph
[16:13] * Guest2029 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[16:14] * karnan (~karnan@121.244.87.117) has joined #ceph
[16:15] * karnan (~karnan@121.244.87.117) Quit ()
[16:15] * squizzi (~squizzi@107.13.31.195) has joined #ceph
[16:15] * karnan (~karnan@121.244.87.117) has joined #ceph
[16:15] * crow (~oftc-webi@c-50-180-203-98.hsd1.ga.comcast.net) has joined #ceph
[16:17] * crow (~oftc-webi@c-50-180-203-98.hsd1.ga.comcast.net) has left #ceph
[16:17] * cr0wrx (~oftc-webi@c-50-180-203-98.hsd1.ga.comcast.net) has joined #ceph
[16:21] * itamarl is now known as Guest2032
[16:21] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[16:23] <Raboo> leseb is it the jewel tag one should use or the tag-build-master-jewel-ubuntu-14.04 tag?
[16:24] * Guest2032 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[16:25] * penguinRaider (~KiKo@14.139.82.6) Quit (Ping timeout: 480 seconds)
[16:26] * vikhyat (~vumrao@121.244.87.116) Quit (Quit: Leaving)
[16:27] * dnunez (~dnunez@nat-pool-bos-t.redhat.com) Quit (Ping timeout: 480 seconds)
[16:27] * vata (~vata@207.96.182.162) has joined #ceph
[16:28] * itamarl is now known as Guest2033
[16:28] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[16:29] * Hemanth (~hkumar_@103.228.221.137) Quit (Ping timeout: 480 seconds)
[16:30] * MentalRay (~MentalRay@office-mtl1-nat-146-218-70-69.gtcomm.net) has joined #ceph
[16:31] * Guest2033 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[16:33] * penguinRaider (~KiKo@69.163.33.182) has joined #ceph
[16:34] * joshd1 (~jdurgin@2602:30a:c089:2b0:fd69:db1a:8fd1:95fd) has joined #ceph
[16:35] * kawa2014 (~kawa@212.110.41.244) Quit (Ping timeout: 481 seconds)
[16:38] * dnunez (~dnunez@nat-pool-bos-u.redhat.com) has joined #ceph
[16:40] * itamarl (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[16:41] * karnan (~karnan@121.244.87.117) Quit (Remote host closed the connection)
[16:45] * huangjun|2 (~kvirc@117.151.50.153) has joined #ceph
[16:46] * huangjun (~kvirc@117.151.50.153) Quit (Read error: Connection reset by peer)
[16:48] * kawa2014 (~kawa@89.184.114.246) has joined #ceph
[16:56] * dnunez (~dnunez@nat-pool-bos-u.redhat.com) Quit (Ping timeout: 480 seconds)
[17:01] * Hatsjoe (~Hatsjoe@149.210.210.150) has joined #ceph
[17:01] * xarses (~xarses@64.124.158.100) has joined #ceph
[17:04] * gauravbafna (~gauravbaf@122.167.204.51) has joined #ceph
[17:04] <Hatsjoe> Hi all, I am having performance issues, I have a 3 node cluster, with total of 72 SSDs (24 per node), and have a dedicated journal drive (also SSD) with 5 OSDs per journal drive. Rados bench results here: http://pastebin.com/7R0vEwX4
[17:04] <Hatsjoe> The network is 10Gbit, and confirmed to perform well with iperf
[17:05] <TheSov> I was asking yesterday if its normal to have objects in a pool that doesnt have any images in it, does anyone have the answer to that? and is there a way to clean up orphaned objects?
[17:05] <Hatsjoe> Can someone point me in the right direction? Or perhaps show me a good tuning guide? Couldn't find anything on Google (or actually, found too much, so I got lost)
[17:05] * wushudoin_ (~wushudoin@2601:646:8281:cfd:2ab2:bdff:fe0b:a6ee) has joined #ceph
[17:06] * dnunez (~dnunez@nat-pool-bos-t.redhat.com) has joined #ceph
[17:06] <Hatsjoe> (Im using the default Ceph settings for the most part, except for the pg count of course)
[17:06] * cholcombe (~chris@c-73-180-29-35.hsd1.or.comcast.net) Quit (Remote host closed the connection)
[17:07] <TheSov> Hatsjoe, is your journal an NVME?
[17:08] <TheSov> and where are your monitors?
[17:08] <Hatsjoe> No
[17:08] <TheSov> then you are doing it wrong
[17:08] <Hatsjoe> And my monitors are also on the 3 nodes
[17:08] <TheSov> an SSD journal is only helpful if you are using spinning disk
[17:09] <TheSov> for all ssd builds a journal would have to be an NVME device
[17:09] <TheSov> or simply 2 devices per osd
[17:09] <Hatsjoe> I had the same performance issues when I did not specify an OSD disk, so each OSD had its journal on a partition on the same drive
[17:09] <TheSov> right
[17:09] <Hatsjoe> s/OSD disk/journal disk/
[17:09] * lpabon (~quassel@nat-pool-bos-t.redhat.com) has joined #ceph
[17:09] <TheSov> im just letting you know u are wasting the journal ssd's right now
[17:10] <TheSov> as per your performance issues
[17:10] <Hatsjoe> Alright, thanks for the advice :)
[17:10] <TheSov> what are your sysctls?
[17:10] <TheSov> echo kernel.pid_max = 4194303 >> /etc/sysctl.conf
[17:10] <TheSov> echo net.ipv4.netfilter.ip_conntrack_max = 196608 >> /etc/sysctl.conf
[17:10] <TheSov> echo net.netfilter.nf_conntrack_max = 1048576 >> /etc/sysctl.conf
[17:10] <TheSov> echo net.core.rmem_max = 16777216 >> /etc/sysctl.conf
[17:10] <TheSov> echo net.core.wmem_max = 16777216 >> /etc/sysctl.conf
[17:10] <TheSov> echo net.core.wmem_default = 262144 >> /etc/sysctl.conf
[17:10] <TheSov> echo net.core.rmem_default = 262144 >> /etc/sysctl.conf
[17:10] <TheSov> echo net.ipv4.tcp_rmem = '8192 87380 16777216' >> /etc/sysctl.conf
[17:10] <TheSov> echo net.ipv4.tcp_wmem = '4096 65536 16777216' >> /etc/sysctl.conf
[17:10] <TheSov> echo net.core.netdev_max_backlog = 30000 >> /etc/sysctl.conf
[17:10] <Hatsjoe> Default for Debian 8
[17:10] <TheSov> echo net.ipv4.tcp_congestion_control = htcp >> /etc/sysctl.conf
[17:10] <TheSov> echo net.ipv4.conf.all.rp_filter = 2 >> /etc/sysctl.conf
[17:10] <TheSov> these are what i use
[17:10] <TheSov> thats no good!
[17:10] <TheSov> use the ones i posted
[17:11] <TheSov> reboot and test again
[17:11] * jermudgeon (~jhaustin@gw1.ttp.biz.whitestone.link) has joined #ceph
[17:12] * gauravbafna (~gauravbaf@122.167.204.51) Quit (Ping timeout: 480 seconds)
[17:13] * cholcombe (~chris@c-73-180-29-35.hsd1.or.comcast.net) has joined #ceph
[17:14] * Jeffrey4l_ (~Jeffrey@119.251.240.50) Quit (Ping timeout: 480 seconds)
[17:16] * mykola (~Mikolaj@193.93.217.49) has joined #ceph
[17:21] * analbeard (~shw@support.memset.com) Quit (Ping timeout: 480 seconds)
[17:21] * shylesh (~shylesh@121.244.87.118) Quit (Remote host closed the connection)
[17:23] * scg (~zscg@valis.gnu.org) has joined #ceph
[17:24] <leseb> Raboo you should use tag-build-master-jewel-ubuntu-14.04
[17:27] * brians_ (~brianoftc@brian.by) Quit (Ping timeout: 480 seconds)
[17:27] <Hatsjoe> TheSov I applied those sysctl settings, except for the conntrack (not using conntrack), and same results
[17:28] <Hatsjoe> Would be awesome if you have any other advice
[17:28] <TheSov> you got no speed increase whatsoever?
[17:28] <Hatsjoe> Nope
[17:28] <TheSov> show me your ceph.conf
[17:28] <Hatsjoe> Nothing interesting in it, only got the mon settings in, and the auth settings
[17:29] <TheSov> i want to see how your networks are split
[17:29] <Hatsjoe> They are not, only got 1 network atm, (no pub and priv setup)
[17:29] <Hatsjoe> But the links are not utilized 100%, not even 10%
[17:29] <TheSov> ...
[17:29] <TheSov> thats bad
[17:29] <Hatsjoe> So I doubt the network is the culprit
[17:29] <Hatsjoe> I know, but its a test setup
[17:29] <Hatsjoe> For production it would be separeted
[17:30] <TheSov> i think you would be surprised the reasons why a nic wont be saturated
[17:30] <TheSov> but lets keep looking
[17:31] <Hatsjoe> Might be useful, when I perform a per OSD bench, they are performing as you'd except from an SSD (about 500MB/s)
[17:31] <TheSov> yes
[17:31] <TheSov> now run a simultanous bench on all disks at once
[17:31] <TheSov> like no joke script that
[17:31] <Hatsjoe> I know I am doing something wrong, just not sure what
[17:31] <TheSov> see waht the speed is
[17:31] <Hatsjoe> Alright
[17:32] <TheSov> use the : to split processes
[17:32] <TheSov> and log them files
[17:32] <TheSov> see if your controller has a global max of 500mbs
[17:32] <Hatsjoe> What do you mean by using colon to split processes?
[17:32] * danieagle (~Daniel@177.94.139.55) has joined #ceph
[17:33] <TheSov> when you create a script in linux u can use the : to launch new proceses from the original
[17:33] <TheSov> the same way its used ina fork bomb
[17:33] * sudocat (~dibarra@2602:306:8bc7:4c50:9010:3ede:27eb:e42e) Quit (Ping timeout: 480 seconds)
[17:33] <koszik> : ?
[17:33] <TheSov> but in this case to bench the disks
[17:33] <koszik> it's a 'null command'
[17:33] <koszik> does nothing
[17:33] <TheSov> err |
[17:33] <TheSov> not :
[17:34] <TheSov> brain not working
[17:34] <koszik> try & instead
[17:34] <Hatsjoe> Haha I know about | and & :P
[17:35] <TheSov> do it then.... sheeeiiiii
[17:35] * DV (~veillard@2001:41d0:a:f29f::1) has joined #ceph
[17:36] <mewald> which release is currently recommended for production deployments?
[17:36] * mhack (~mhack@2604:6000:8d40:9400::5) Quit (Quit: Leaving)
[17:37] * dsl (~dsl@204.155.27.220) has joined #ceph
[17:37] <nils_> lol
[17:38] * rraja (~rraja@121.244.87.117) Quit (Quit: Leaving)
[17:39] <Hatsjoe> TheSov when performing osd bench on all OSDs at once, they are still performing as expected
[17:39] <SamYaple> mewald: hammer or jewel. I would go with jewel
[17:40] <mewald> SamYaple: ok, I have some issues with blocking OSDs all the time. So I thought jewel might be too new. Was hoping you guys said "No No, dont use jewel" :D
[17:41] <SamYaple> mewald: pretty solid for me. what type of workload are you running?
[17:42] <mewald> SamYaple: Glance, Cinder, Nova
[17:42] <SamYaple> so for openstack there is some tuning you can do
[17:42] <Hatsjoe> Scratch that last part, I fail at reading, and cannot count...
[17:42] <SamYaple> but it comes at a cost
[17:42] <mewald> what's that cost and what's that tuning? :D
[17:42] <Hatsjoe> When doing them all at once, performance on the OSDs sucks
[17:43] <SamYaple> mewald: if you use openstack "properly" then vms are disposible. ie when a compute dies you build _new_ instances, you dont try to save old ones
[17:43] <SamYaple> mewald: in that case you jack the writeback up for all the things. this means you risk losing data when a compute goes away
[17:43] <SamYaple> mewald: makes it far more performant though
[17:46] <koszik> Hatsjoe, controller bandwidth problem, or host cpu, or something like that? check atop during that test, you should be immediately see what's wrong (it'll be in red:) )
[17:46] <scg> is it a bad idea to use several heads (at least 4) with kvm+ceph in the same machine (each machine with 256GB of ram and 32 CPU)?
[17:46] <mewald> SamYaple: well, we have no real workload on it yet. everything is just in "testing" and ceph nodes show almost no load. The cluster ran fine for a couple of weeks, then suddently (within a few hours) like 80% of the OSD went down. Some could be revived by restarting the service, others crash immediately after trying so. It's the second time this happend now only that this time I wasn't able to make ceph recover to good health. We decided to redo the entire clus
[17:47] * rdas (~rdas@121.244.87.116) Quit (Ping timeout: 480 seconds)
[17:48] * neha (~nojha@2601:646:8a00:8ab1:8755:db62:bde:a798) has joined #ceph
[17:48] * TMM (~hp@185.5.121.201) Quit (Quit: Ex-Chat)
[17:49] <mewald> SamYaple: btw, I need to talk to you about ceph in kolla. You're not in the kolla irc very often are you?
[17:49] * neha (~nojha@2601:646:8a00:8ab1:8755:db62:bde:a798) Quit ()
[17:50] <SamYaple> mewald: i left kolla a while back. but i implemented all the ceph-in-kolla stuff so im probably the best bet to answer your question
[17:50] <TheSov> Hatsjoe, can i get a pastebin of your lsblk
[17:50] <SamYaple> if its configuration related, that probably something for #kolla
[17:51] * linuxkidd (~linuxkidd@ip70-189-207-54.lv.lv.cox.net) has joined #ceph
[17:51] <Hatsjoe> TheSov http://pastebin.com/b92wZnX0
[17:51] <mewald> SamYaple: It's more generally about Ceph integration. I want to implement integration of external ceph (non kolla managed) and need somebody to talk to about general approach to this. Probably, best to talk you #kolla. They referred to you though, as the ceph guy :)
[17:54] * neha (~nojha@2601:646:8a00:8ab1:8755:db62:bde:a798) has joined #ceph
[17:54] <SamYaple> mewald: i never implemented the external ceph code. itll be a bit of a problem. i could tell you how to do it manually...
[17:54] * nojha_ (~nojha@2601:646:8a00:8ab1:8755:db62:bde:a798) has joined #ceph
[17:56] * huangjun|2 (~kvirc@117.151.50.153) Quit (Ping timeout: 480 seconds)
[17:57] * newbie (~kvirc@host217-114-156-249.pppoe.mark-itt.net) has joined #ceph
[17:57] <TheSov> Hatsjoe, where is your /var
[17:57] <TheSov> is that on spinning disk?
[17:58] <koszik> why don't you try atop isntead of guessing what's the bottleneck? it'll show you if it's the cpu or a certain disk or all of them (ie. controller)
[17:59] * KindOne (kindone@0001a7db.user.oftc.net) Quit (Ping timeout: 480 seconds)
[18:00] * davidzlap (~Adium@2605:e000:1313:8003:11df:e84:5ff5:43a4) has joined #ceph
[18:00] <Hatsjoe> TheSov /var is on my OS drives, which are 2 SSDs in software raid 1
[18:01] <Hatsjoe> Need to catch my train, will be back online in the train :)
[18:02] * Hatsjoe (~Hatsjoe@149.210.210.150) Quit (Quit: WeeChat 1.5)
[18:02] <TheSov> ok your monitors are on the same systems?
[18:02] <TheSov> ok
[18:03] * jdillaman (~jdillaman@h187.196.31.71.dynamic.ip.windstream.net) Quit (Quit: jdillaman)
[18:04] * sudocat (~dibarra@192.185.1.20) has joined #ceph
[18:06] * gregmark (~Adium@68.87.42.115) has joined #ceph
[18:10] * kawa2014 (~kawa@89.184.114.246) Quit (Quit: Leaving)
[18:11] * Be-El (~blinke@nat-router.computational.bio.uni-giessen.de) Quit (Quit: Leaving.)
[18:11] * kefu is now known as kefu|afk
[18:12] * KindOne (~KindOne@h183.44.30.71.dynamic.ip.windstream.net) has joined #ceph
[18:12] * Hatsjoe (~Hatsjoe@178.226.86.224) has joined #ceph
[18:12] <Hatsjoe> Alright, I'm back :)
[18:13] * realitysandwich (~perry@2001:920:1846:1dc0:527b:9dff:fe42:2789) has joined #ceph
[18:14] * Sirenia (~sirenia@454028b1.test.dnsbl.oftc.net) Quit (Ping timeout: 480 seconds)
[18:14] * analbeard (~shw@host109-150-56-204.range109-150.btcentralplus.com) has joined #ceph
[18:14] <Hatsjoe> koszik, when I did what you said, the line with SWP vmcom and vmlim was red, it was not swapping or using more than 50% of the avail mem, I read somewhere that if that line becomes red, it has something to do with mem overcommitment?
[18:14] * scg (~zscg@valis.gnu.org) Quit (Ping timeout: 480 seconds)
[18:17] <koszik> probably, but i don't think they're in any way causing performance issues; were those the only ones in red? no disks or cpus?
[18:17] <Hatsjoe> For a brief moment, 3 disks (out of 24) were red, but not long enough for me to see which ones
[18:18] * analbeard (~shw@host109-150-56-204.range109-150.btcentralplus.com) Quit ()
[18:18] * analbeard (~shw@host109-150-56-204.range109-150.btcentralplus.com) has joined #ceph
[18:22] <Hatsjoe> koszik I re-ran the test, now seeing 3 out of 4 journal drives being red with 100% busy, there it probably goes wrong now
[18:22] <Hatsjoe> Also quite logical since I got 5 SSD OSDs per journal SSD
[18:22] <koszik> you should just let the ssds be their own journals
[18:23] <koszik> you don't even need a separate partition
[18:23] <Hatsjoe> When I firt setup the cluster, I did not specify the journal drive for the OSDs, and per default, it made /dev/sdX1 the journal partition, should I do that again?
[18:23] <koszik> they're ssds, after all, and logical location has nothing to do with physical location
[18:23] * DeMiNe0 (~DeMiNe0@104.131.119.74) Quit (Ping timeout: 480 seconds)
[18:24] * DeMiNe0 (~DeMiNe0@104.131.119.74) has joined #ceph
[18:26] * bjornar_ (~bjornar@109.247.131.38) Quit (Ping timeout: 480 seconds)
[18:28] <Hatsjoe> koszik when you say you dont need a separate partition, do you mean performance wqould be better, or is it a matter of preference?
[18:28] * rotbeard (~redbeard@185.32.80.238) Quit (Quit: Leaving)
[18:28] * brians_ (~brianoftc@brian.by) has joined #ceph
[18:30] <koszik> it's irrelevant performance-wise
[18:30] * EthanL (~lamberet@cce02cs4036-fa12-z.ams.hpecore.net) Quit (Ping timeout: 480 seconds)
[18:31] <koszik> but you'll lose some usable space if you partition it (unless your journal partition is always at 100%)
[18:31] * karnan (~karnan@103.227.98.153) has joined #ceph
[18:32] <Hatsjoe> Gotcha
[18:32] <Hatsjoe> Without specifying the journal, it creates a 5GB partition by default, how would one define the data partition to be used to store the journal?
[18:35] <koszik> my journals are just on the osd fs, without having to specify anything
[18:35] <koszik> i think that's the default when creating an osd with ceph-osd
[18:35] <Hatsjoe> Maybe thats the difference, I've been using ceph-deploy for that
[18:35] <koszik> but it looks like the journal has a fixed size, so it doesn't really matter
[18:36] <Hatsjoe> Guess so, but making it bigger or smaller is easier when its on the osd fs and not a separate partition :)
[18:36] <koszik> indeed
[18:37] <koszik> administratively less complex is the way i'd put it (but feel free to correct me if anyone knows better)
[18:37] <Hatsjoe> I'd agree
[18:38] <Hatsjoe> If I recall correctly from the docs, it is possible to change the journal drive/partition/settings after the OSD has been created right? Just a matter of changing it, and let ceph make a new journal
[18:40] <Hatsjoe> Need to get off the train, really need to get myself a bouncer :) Thanks for the help TheSov and koszik, I'll be online later to let you guys know what I did and wether or not it made a difference
[18:41] * Hatsjoe (~Hatsjoe@178.226.86.224) Quit (Quit: WeeChat 1.5)
[18:41] * EthanL (~lamberet@cce02cs4036-fa12-z.ams.hpecore.net) has joined #ceph
[18:41] * mykola (~Mikolaj@193.93.217.49) Quit (Ping timeout: 480 seconds)
[18:46] * Brochacho (~alberto@c-50-141-135-98.hsd1.il.comcast.net) Quit (Quit: Brochacho)
[18:46] * jermudgeon (~jhaustin@gw1.ttp.biz.whitestone.link) Quit (Quit: jermudgeon)
[18:48] * mykola (~Mikolaj@193.93.217.54) has joined #ceph
[18:50] <mewald> SamYaple: manually would be good to know, too!
[18:51] * johnavp1989 (~jpetrini@8.39.115.8) has joined #ceph
[18:51] <- *johnavp1989* To prove that you are human, please enter the result of 8+3
[18:53] * bvi (~Bastiaan@185.56.32.1) Quit (Quit: Leaving)
[18:57] * jermudgeon (~jhaustin@dps.biz.whitestone.link) has joined #ceph
[18:57] * Skaag (~lunix@65.200.54.234) has joined #ceph
[18:59] * jermudgeon (~jhaustin@dps.biz.whitestone.link) Quit ()
[19:00] * kefu|afk (~kefu@114.92.118.31) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[19:02] * DanFoster (~Daniel@2a00:1ee0:3:1337:8c56:821a:667:cc0c) Quit (Quit: Leaving)
[19:03] * Brochacho (~alberto@c-50-141-135-98.hsd1.il.comcast.net) has joined #ceph
[19:04] * vasu (~vasu@c-73-231-60-138.hsd1.ca.comcast.net) has joined #ceph
[19:07] * penguinRaider (~KiKo@69.163.33.182) Quit (Ping timeout: 480 seconds)
[19:08] * rwheeler (~rwheeler@nat-pool-bos-t.redhat.com) Quit (Quit: Leaving)
[19:09] * scg (~zscg@valis.gnu.org) has joined #ceph
[19:13] * analbeard (~shw@host109-150-56-204.range109-150.btcentralplus.com) Quit (Quit: Leaving.)
[19:17] * penguinRaider (~KiKo@69.163.33.182) has joined #ceph
[19:19] * KUSmurf (~elt@tor2r.ins.tor.net.eu.org) has joined #ceph
[19:20] * squizzi (~squizzi@107.13.31.195) Quit (Ping timeout: 480 seconds)
[19:23] * dgurtner (~dgurtner@84-73-130-19.dclient.hispeed.ch) Quit (Ping timeout: 480 seconds)
[19:24] * realitysandwich (~perry@2001:920:1846:1dc0:527b:9dff:fe42:2789) Quit (Ping timeout: 480 seconds)
[19:26] * squizzi (~squizzi@107.13.31.195) has joined #ceph
[19:26] * Chris_ke (~ke@180.168.170.2) Quit (Ping timeout: 480 seconds)
[19:27] * Chris_ke (~ke@180.168.170.2) has joined #ceph
[19:31] * blynch (~blynch@vm-nat.msi.umn.edu) Quit (Remote host closed the connection)
[19:34] * bjornar_ (~bjornar@ti0099a430-0410.bb.online.no) has joined #ceph
[19:38] * Skaag1 (~lunix@65.200.54.234) has joined #ceph
[19:39] * debian112 (~bcolbert@c-73-184-103-26.hsd1.ga.comcast.net) Quit (Ping timeout: 480 seconds)
[19:43] * Skaag (~lunix@65.200.54.234) Quit (Ping timeout: 480 seconds)
[19:48] * bjornar_ (~bjornar@ti0099a430-0410.bb.online.no) Quit (Ping timeout: 480 seconds)
[19:49] * KUSmurf (~elt@7V7AAG248.tor-irc.dnsbl.oftc.net) Quit ()
[19:49] * MentalRay (~MentalRay@office-mtl1-nat-146-218-70-69.gtcomm.net) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[19:51] * MentalRay (~MentalRay@office-mtl1-nat-146-218-70-69.gtcomm.net) has joined #ceph
[19:51] * debian112 (~bcolbert@c-73-184-103-26.hsd1.ga.comcast.net) has joined #ceph
[19:51] * MentalRay (~MentalRay@office-mtl1-nat-146-218-70-69.gtcomm.net) Quit ()
[19:51] * ade (~abradshaw@dslb-188-102-071-182.188.102.pools.vodafone-ip.de) Quit (Quit: Too sexy for his shirt)
[19:51] * MentalRay (~MentalRay@office-mtl1-nat-146-218-70-69.gtcomm.net) has joined #ceph
[19:53] * rwheeler (~rwheeler@pool-173-48-195-215.bstnma.fios.verizon.net) has joined #ceph
[19:53] * joshd1 (~jdurgin@2602:30a:c089:2b0:fd69:db1a:8fd1:95fd) Quit (Quit: Leaving.)
[19:53] * mattbenjamin (~mbenjamin@12.118.3.106) has joined #ceph
[19:55] * linuxkidd (~linuxkidd@ip70-189-207-54.lv.lv.cox.net) Quit (Quit: Leaving)
[19:55] * joshd1 (~jdurgin@2602:30a:c089:2b0:fd69:db1a:8fd1:95fd) has joined #ceph
[19:55] * mewald (~Adium@185.80.187.212) Quit (Quit: Leaving.)
[19:57] * linuxkidd (~linuxkidd@ip70-189-207-54.lv.lv.cox.net) has joined #ceph
[20:03] * stiopa (~stiopa@cpc73832-dals21-2-0-cust453.20-2.cable.virginm.net) has joined #ceph
[20:03] * seosepa (~sepa@aperture.GLaDOS.info) Quit (Read error: Connection reset by peer)
[20:05] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:9901:29b4:b6c5:3fa9) Quit (Ping timeout: 480 seconds)
[20:05] * seosepa (~sepa@aperture.GLaDOS.info) has joined #ceph
[20:05] * GeoTracer (~Geoffrey@41.77.153.99) Quit (Ping timeout: 480 seconds)
[20:06] * MentalRay (~MentalRay@office-mtl1-nat-146-218-70-69.gtcomm.net) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[20:06] * GeoTracer (~Geoffrey@41.77.153.99) has joined #ceph
[20:14] * KindOne (~KindOne@0001a7db.user.oftc.net) Quit (Ping timeout: 480 seconds)
[20:14] * evelu (~erwan@37.162.138.103) Quit (Ping timeout: 480 seconds)
[20:17] * mewald (~Adium@82.113.99.198) has joined #ceph
[20:20] * dgurtner (~dgurtner@84-73-130-19.dclient.hispeed.ch) has joined #ceph
[20:22] * gauravbafna (~gauravbaf@122.167.204.51) has joined #ceph
[20:24] * evelu (~erwan@2a01:e34:eecb:7400:4eeb:42ff:fedc:8ac) has joined #ceph
[20:25] * ggarg_ (~ggarg@ip5f5bc451.dynamic.kabel-deutschland.de) has joined #ceph
[20:25] * linjan (~linjan@176.195.217.168) Quit (Ping timeout: 480 seconds)
[20:26] * ade (~abradshaw@dslb-188-102-071-182.188.102.pools.vodafone-ip.de) has joined #ceph
[20:26] * gauravbafna (~gauravbaf@122.167.204.51) Quit (Remote host closed the connection)
[20:27] * ade (~abradshaw@dslb-188-102-071-182.188.102.pools.vodafone-ip.de) Quit ()
[20:28] * KindOne (~KindOne@198.14.205.1) has joined #ceph
[20:29] * ggarg_ (~ggarg@ip5f5bc451.dynamic.kabel-deutschland.de) Quit ()
[20:29] * varuag (~Gaurav@ip5f5bc451.dynamic.kabel-deutschland.de) has joined #ceph
[20:32] * madkiss (~madkiss@2001:6f8:12c3:f00f:5db9:d99a:41fe:bfe4) has joined #ceph
[20:33] * bvi (~Bastiaan@102-117-145-85.ftth.glasoperator.nl) has joined #ceph
[20:34] * Silentspy (~AG_Scott@tor2r.ins.tor.net.eu.org) has joined #ceph
[20:36] * linjan (~linjan@176.195.217.168) has joined #ceph
[20:38] * Heebie (~thebert@dub-bdtn-office-r1.net.digiweb.ie) Quit (Read error: Connection reset by peer)
[20:39] * brad_mssw (~brad@66.129.88.50) Quit (Quit: Leaving)
[20:40] * Heebie (~thebert@dub-bdtn-office-r1.net.digiweb.ie) has joined #ceph
[20:40] * wjw-freebsd (~wjw@smtp.digiware.nl) has joined #ceph
[20:44] * penguinRaider (~KiKo@69.163.33.182) Quit (Ping timeout: 480 seconds)
[20:44] <mewald> SamYaple: My first try would be to run a bash in e.g. the glance container and then place ceph.conf and keyring there manually.
[20:45] * jermudgeon (~jhaustin@31.207.56.59) has joined #ceph
[20:46] * reed (~reed@216.38.134.18) has joined #ceph
[20:48] * jermudgeon_ (~jhaustin@31.207.56.59) has joined #ceph
[20:48] * jermudgeon (~jhaustin@31.207.56.59) Quit (Read error: Connection reset by peer)
[20:48] * jermudgeon_ is now known as jermudgeon
[20:54] * penguinRaider (~KiKo@69.163.33.182) has joined #ceph
[20:55] * bjornar_ (~bjornar@85.19.150.242) has joined #ceph
[20:56] * bniver (~bniver@nat-pool-bos-u.redhat.com) Quit (Remote host closed the connection)
[20:57] * derjohn_mob (~aj@46.189.28.41) Quit (Ping timeout: 480 seconds)
[21:03] * dsl (~dsl@204.155.27.220) Quit (Quit: Leaving...)
[21:04] * Silentspy (~AG_Scott@4MJAAHF0R.tor-irc.dnsbl.oftc.net) Quit ()
[21:16] * bjornar_ (~bjornar@85.19.150.242) Quit (Ping timeout: 480 seconds)
[21:17] * karnan (~karnan@103.227.98.153) Quit (Remote host closed the connection)
[21:18] <mewald> I am trying to deploy a few OSDs with ceph-deploy. I for every OSD I get the following message: https://gist.github.com/mewald1/41e63121ff3bbf8ca4ca8bf96dab0ea6 What happening here?
[21:21] * jermudgeon (~jhaustin@31.207.56.59) Quit (Ping timeout: 480 seconds)
[21:34] * toMeloos (~toMeloos@53568B3D.cm-6-7c.dynamic.ziggo.nl) has joined #ceph
[21:38] * joshd1 (~jdurgin@2602:30a:c089:2b0:fd69:db1a:8fd1:95fd) Quit (Quit: Leaving.)
[21:39] * MentalRay (~MentalRay@office-mtl1-nat-146-218-70-69.gtcomm.net) has joined #ceph
[21:41] * rendar (~I@host45-183-dynamic.49-79-r.retail.telecomitalia.it) Quit (Ping timeout: 480 seconds)
[21:51] * Hatsjoe (~Hatsjoe@2a01:7c8:aaba:4f8:5054:ff:fe6e:d37d) has joined #ceph
[21:55] <Hatsjoe> Good evening :)
[21:57] * lpabon (~quassel@nat-pool-bos-t.redhat.com) Quit (Remote host closed the connection)
[21:58] * bniver (~bniver@pool-173-48-58-27.bstnma.fios.verizon.net) has joined #ceph
[22:02] * toMeloos (~toMeloos@53568B3D.cm-6-7c.dynamic.ziggo.nl) Quit (Quit: Ik ga weg)
[22:04] * mhack (~mhack@24-151-36-149.dhcp.nwtn.ct.charter.com) has joined #ceph
[22:06] <mewald> hi :)
[22:07] * rendar (~I@host45-183-dynamic.49-79-r.retail.telecomitalia.it) has joined #ceph
[22:07] * debian112 (~bcolbert@c-73-184-103-26.hsd1.ga.comcast.net) Quit (Ping timeout: 480 seconds)
[22:13] * Ceph-Log-Bot (~logstash@2a00:f10:121:400:4da:18ff:fe00:14d0) has joined #ceph
[22:13] * Ceph-Log-Bot (~logstash@2a00:f10:121:400:4da:18ff:fe00:14d0) Quit (Remote host closed the connection)
[22:16] <mewald> is it possible to explicitly set a key for a user in ceph? Like a parameter to "ceph auth add" or some other way?
[22:17] * Brochacho (~alberto@c-50-141-135-98.hsd1.il.comcast.net) Quit (Quit: Brochacho)
[22:19] * debian112 (~bcolbert@c-73-184-103-26.hsd1.ga.comcast.net) has joined #ceph
[22:19] * mykola (~Mikolaj@193.93.217.54) Quit (Quit: away)
[22:20] * georgem (~Adium@206.108.127.16) Quit (Quit: Leaving.)
[22:20] * nils_ (~nils_@doomstreet.collins.kg) Quit (Quit: This computer has gone to sleep)
[22:27] <via> `/win 43
[22:27] <via> dammit
[22:28] * bjornar_ (~bjornar@ti0099a430-0410.bb.online.no) has joined #ceph
[22:36] * linjan (~linjan@176.195.217.168) Quit (Ping timeout: 480 seconds)
[22:38] * Pirate (~rapedex@185.65.134.74) has joined #ceph
[22:40] * varuag (~Gaurav@ip5f5bc451.dynamic.kabel-deutschland.de) Quit (Ping timeout: 480 seconds)
[22:51] * bvi (~Bastiaan@102-117-145-85.ftth.glasoperator.nl) Quit (Ping timeout: 480 seconds)
[22:53] * micw (~micw@p5785DD66.dip0.t-ipconnect.de) has joined #ceph
[22:53] <micw> hi
[22:54] <micw> i try to deploy ceph with ansible. mon was no problem. osd setup i did step by step (like in manual setup)
[22:54] <micw> the problem is that my osd is always shown as "down"
[22:54] <micw> the process starts
[22:55] <micw> i can't find anything helpfull in the log
[22:56] <mewald> micw: is the OSD running on the server? (you could check it "ps aux | grep ceph" for example)
[22:56] <micw> yes
[22:56] <micw> process runs
[22:57] * niknakpaddywak (~xander.ni@outbound.lax.demandmedia.com) has joined #ceph
[22:57] <micw> log says: irc://irc.oftc.net:6667
[22:57] <micw> oops ^^
[22:57] <micw> log says: osd.4 956 done with init, starting boot process
[22:59] <micw> before i saw some of these: osd.4 956 crush map has features 2200130813952 was 8705, adjusting msgr requires for mons
[23:08] * scg (~zscg@valis.gnu.org) Quit (Quit: Leaving)
[23:08] * Pirate (~rapedex@4MJAAHF46.tor-irc.dnsbl.oftc.net) Quit ()
[23:09] <micw> seems to be this problem: http://serverfault.com/questions/671372/ceph-osd-always-down-in-ubuntu-14-04-1
[23:09] * ffilzwin (~ffilz@c-76-115-190-27.hsd1.or.comcast.net) Quit (Read error: Connection reset by peer)
[23:10] * ffilzwin (~ffilz@c-76-115-190-27.hsd1.or.comcast.net) has joined #ceph
[23:10] * ffilz (~ffilz@c-76-115-190-27.hsd1.or.comcast.net) Quit (Ping timeout: 480 seconds)
[23:11] * wes_dillingham (~wes_dilli@140.247.242.44) Quit (Ping timeout: 480 seconds)
[23:11] * ffilz (~ffilz@c-76-115-190-27.hsd1.or.comcast.net) has joined #ceph
[23:13] * wes_dillingham (~wes_dilli@65.112.8.193) has joined #ceph
[23:17] <micw> yeah that was the problem. fixed now. seems that "ceph osd create (randomid) num" followed by ceph-osd --mkfs doe not use the same uuid
[23:18] <micw> how can i see in "ceph -s" if too many osds are missing and data will be unavailable?
[23:20] <micw> is this "down" state?
[23:28] * derjohn_mob (~aj@p578b6aa1.dip0.t-ipconnect.de) has joined #ceph
[23:37] * newbie (~kvirc@host217-114-156-249.pppoe.mark-itt.net) Quit (Ping timeout: 480 seconds)
[23:40] * ItsCriminalAFK (~PappI@46.166.188.199) has joined #ceph
[23:45] * Brochacho (~alberto@c-50-141-135-98.hsd1.il.comcast.net) has joined #ceph
[23:45] * dnunez (~dnunez@nat-pool-bos-t.redhat.com) Quit (Quit: Leaving)
[23:48] * dgurtner (~dgurtner@84-73-130-19.dclient.hispeed.ch) Quit (Ping timeout: 480 seconds)
[23:54] * vata (~vata@207.96.182.162) Quit (Quit: Leaving.)
[23:54] <TheSov> who the hell is pushing all their osd's via ceph.conf?
[23:54] <TheSov> do people actually do that?
[23:54] * wes_dillingham (~wes_dilli@65.112.8.193) Quit (Quit: wes_dillingham)
[23:57] * mewald (~Adium@82.113.99.198) has left #ceph

These logs were automatically created by CephLogBot on irc.oftc.net using the Java IRC LogBot.