#ceph IRC Log

Index

IRC Log for 2016-10-14

Timestamps are in GMT/BST.

[0:00] * newdave (~newdave@36-209-181-180.cpe.skymesh.net.au) Quit (Read error: Connection reset by peer)
[0:00] <cetex> reads are similar to writes
[0:00] <cetex> so i guess it's the cephfs client
[0:01] * newdave (~newdave@36-209-181-180.cpe.skymesh.net.au) has joined #ceph
[0:03] <cetex> but was that around march?
[0:03] <cetex> the blk-elevator or whatever it was :)
[0:03] * kristen (~kristen@134.134.139.78) Quit (Quit: Leaving)
[0:04] <doppelgrau> cetex: not really sure when it was, was just a sidenote on the ml for me, since I use usually cephfs-fuse (with no real performance requirements) and rbd with qemu
[0:06] * kristen (~kristen@134.134.139.78) has joined #ceph
[0:07] <cetex> ah, right
[0:14] <doppelgrau> so I just rememberd that ???I read sometime ago something with readahead problems in some kernel version???
[0:14] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:e87c:2761:738e:5817) Quit (Ping timeout: 480 seconds)
[0:14] <doppelgrau> not very precise, sorry
[0:15] <cetex> yeah.
[0:16] <cetex> I definitely understand. i can't remember what i had for dinner yesterday, but i do know i had dinner ;)
[0:16] <lurbs> There are major speedups possible by increasing /sys/block/$device/queue/read_ahead_kb, but that's for inside VMs.
[0:18] <cetex> I'll check another kernel, maybe move to 4.7 or 4.8 :>
[0:18] <cetex> also, just read about bluestore
[0:18] <cetex> seems awesome :)
[0:19] <bstillwell> It is, just not ready for production use yet...
[0:19] <cetex> yeah. but will see in 6months if it is considered stable enough
[0:19] <bstillwell> It's supposed to be stable in Kraken and default in Luminous
[0:20] <bstillwell> last I heard
[0:22] * newdave_ (~newdave@36-209-181-180.cpe.skymesh.net.au) has joined #ceph
[0:22] <cetex> it's gonna be nice i think
[0:22] * newdave (~newdave@36-209-181-180.cpe.skymesh.net.au) Quit (Read error: Connection reset by peer)
[0:25] <doppelgrau> yeah, the slides I???ve seen look promissing, curious what It will do for a rbd-workload and how the ???Journal SSD??? can be used for performance benefits
[0:25] * hbogert (~Adium@ip54541f88.adsl-surfen.hetnet.nl) Quit (Quit: Leaving.)
[0:26] <cetex> yeah. I saw something about it rebalancing and stuff, i almost got the feeling that it could work with the ssd as a local cache tier
[0:27] * pdhange (~pdhange@61-69-103-54.mel.static-ipl.aapt.com.au) has joined #ceph
[0:29] <doppelgrau> I got that feeling too, but that was somehow ???fuzzy??? for me tif that affects the data or only the internal rocks-db and the logs
[0:32] <doppelgrau> but on the other side, rocksdb an wal wourld be more or less the current journal (for small IOs written to the wal instead directly to the disk) + filesystem IO?! so still a benefit
[0:38] * funnel (~funnel@0001c7d4.user.oftc.net) Quit (Ping timeout: 480 seconds)
[0:38] * makz (~makz@2a00:d880:6:2d7::e463) Quit (Ping timeout: 480 seconds)
[0:38] <doppelgrau> or switching to cache pool in front of the HDDs
[0:42] * ircolle (~ircolle@166.170.48.4) has joined #ceph
[0:43] * cmart (~cmart@150.135.210.195) Quit (Ping timeout: 480 seconds)
[0:44] <doppelgrau> http://www.spinics.net/lists/ceph-users/msg31730.html <- small post mortem of the cluster/website downtime
[0:47] <cetex> nice :)
[0:47] * funnel (~funnel@0001c7d4.user.oftc.net) has joined #ceph
[0:48] * Unai (~Adium@50-115-70-150.static-ip.telepacific.net) Quit (Ping timeout: 480 seconds)
[0:51] * rwheeler (~rwheeler@174-23-105-60.slkc.qwest.net) Quit (Quit: Leaving)
[1:00] * vasu (~vasu@c-73-231-60-138.hsd1.ca.comcast.net) Quit (Quit: Leaving)
[1:15] * oms101 (~oms101@p20030057EA44F600C6D987FFFE4339A1.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[1:20] * ircolle (~ircolle@166.170.48.4) Quit (Quit: Leaving.)
[1:24] * sudocat (~dibarra@192.185.1.20) Quit (Ping timeout: 480 seconds)
[1:24] * oms101 (~oms101@p20030057EA507900C6D987FFFE4339A1.dip0.t-ipconnect.de) has joined #ceph
[1:25] * doppelgrau (~doppelgra@dslb-088-072-094-200.088.072.pools.vodafone-ip.de) Quit (Quit: doppelgrau)
[1:26] * linuxkidd (~linuxkidd@ip70-189-214-97.lv.lv.cox.net) Quit (Ping timeout: 480 seconds)
[1:28] * jlayton (~jlayton@107.13.71.30) Quit (Quit: ZNC 1.6.2 - http://znc.in)
[1:28] * jlayton (~jlayton@107.13.71.30) has joined #ceph
[1:30] * vata1 (~vata@207.96.182.162) Quit (Quit: Leaving.)
[1:31] * Behedwin (~Inuyasha@185.65.134.74) has joined #ceph
[1:33] * Skaag (~lunix@65.200.54.234) Quit (Quit: Leaving.)
[1:36] * linuxkidd (~linuxkidd@ip70-189-214-97.lv.lv.cox.net) has joined #ceph
[1:37] * xarses (~xarses@64.124.158.3) Quit (Ping timeout: 480 seconds)
[1:38] * wushudoin (~wushudoin@2601:646:8200:c9f0:2ab2:bdff:fe0b:a6ee) Quit (Ping timeout: 480 seconds)
[1:43] * mattbenjamin1 (~mbenjamin@97-117-49-192.slkc.qwest.net) Quit (Ping timeout: 480 seconds)
[1:44] * stiopa (~stiopa@cpc73832-dals21-2-0-cust453.20-2.cable.virginm.net) has joined #ceph
[1:46] * xarses (~xarses@73.93.155.43) has joined #ceph
[1:48] * xarses_ (~xarses@172.56.38.7) has joined #ceph
[1:54] * xarses (~xarses@73.93.155.43) Quit (Ping timeout: 480 seconds)
[2:00] * nilez (~nilez@ec2-52-37-170-77.us-west-2.compute.amazonaws.com) Quit (Ping timeout: 480 seconds)
[2:01] * Behedwin (~Inuyasha@185.65.134.74) Quit ()
[2:01] * sudocat (~dibarra@104-188-116-197.lightspeed.hstntx.sbcglobal.net) has joined #ceph
[2:04] * xarses_ (~xarses@172.56.38.7) Quit (Ping timeout: 480 seconds)
[2:07] * cmart (~cmart@150.135.210.115) has joined #ceph
[2:09] * vata (~vata@96.127.202.136) Quit (Quit: Leaving.)
[2:09] * cmart (~cmart@150.135.210.115) Quit (Read error: Connection reset by peer)
[2:09] * nilez (~nilez@ec2-52-37-170-77.us-west-2.compute.amazonaws.com) has joined #ceph
[2:09] * cmart (~cmart@150.135.210.113) has joined #ceph
[2:10] * linuxkidd (~linuxkidd@ip70-189-214-97.lv.lv.cox.net) Quit (Ping timeout: 480 seconds)
[2:14] * davidzlap (~Adium@2605:e000:1313:8003:6066:d3ef:ff1c:3b58) Quit (Quit: Leaving.)
[2:19] * davidzlap (~Adium@2605:e000:1313:8003:6066:d3ef:ff1c:3b58) has joined #ceph
[2:21] * linuxkidd (~linuxkidd@ip70-189-214-97.lv.lv.cox.net) has joined #ceph
[2:21] * stiopa (~stiopa@cpc73832-dals21-2-0-cust453.20-2.cable.virginm.net) Quit (Ping timeout: 480 seconds)
[2:23] * diver (~diver@cpe-2606-A000-111B-C12B-DD35-A89E-F284-3AA.dyn6.twc.com) has joined #ceph
[2:24] * vata (~vata@96.127.202.136) has joined #ceph
[2:27] * cmart (~cmart@150.135.210.113) Quit (Ping timeout: 480 seconds)
[2:31] * diver (~diver@cpe-2606-A000-111B-C12B-DD35-A89E-F284-3AA.dyn6.twc.com) Quit (Ping timeout: 480 seconds)
[2:34] * georgem (~Adium@45.72.224.60) has joined #ceph
[2:35] * tobiash (~quassel@212.118.206.70) Quit (Quit: No Ping reply in 180 seconds.)
[2:36] * kristen (~kristen@134.134.139.78) Quit (Quit: Leaving)
[2:36] * chiluk (~quassel@172.34.213.162.lcy-01.canonistack.canonical.com) Quit (Quit: No Ping reply in 180 seconds.)
[2:36] * tobiash (~quassel@212.118.206.70) has joined #ceph
[2:36] * georgem (~Adium@45.72.224.60) Quit ()
[2:37] * georgem (~Adium@206.108.127.16) has joined #ceph
[2:38] * chiluk (~quassel@172.34.213.162.lcy-01.canonistack.canonical.com) has joined #ceph
[2:38] * Anticimex (~Anticimex@ec2-52-57-137-19.eu-central-1.compute.amazonaws.com) Quit (Remote host closed the connection)
[2:38] * Anticimex (anticimex@52.57.137.19) has joined #ceph
[2:40] * linuxkidd (~linuxkidd@ip70-189-214-97.lv.lv.cox.net) Quit (Ping timeout: 480 seconds)
[2:45] * thoht (~fox@2a01:e34:ef3e:5270:ba27:ebff:fe18:4629) Quit (Ping timeout: 480 seconds)
[2:49] * linuxkidd (~linuxkidd@2600:1011:b15b:9724:b851:d5c7:3460:6409) has joined #ceph
[2:50] * lx0 (~aoliva@lxo.user.oftc.net) has joined #ceph
[2:52] * salwasser (~Adium@2601:197:800:6ea1:10e4:fc5:f18f:7582) has joined #ceph
[2:53] * mnaser (~mnaser@162.253.53.193) Quit (Ping timeout: 480 seconds)
[2:57] * lxo (~aoliva@lxo.user.oftc.net) Quit (Ping timeout: 480 seconds)
[2:57] * linuxkidd (~linuxkidd@2600:1011:b15b:9724:b851:d5c7:3460:6409) Quit (Read error: No route to host)
[3:00] * davidzlap (~Adium@2605:e000:1313:8003:6066:d3ef:ff1c:3b58) Quit (Quit: Leaving.)
[3:01] * vbellur (~vijay@71.234.224.255) has joined #ceph
[3:07] * sudocat (~dibarra@104-188-116-197.lightspeed.hstntx.sbcglobal.net) Quit (Ping timeout: 480 seconds)
[3:18] * linuxkidd (~linuxkidd@ip70-189-214-97.lv.lv.cox.net) has joined #ceph
[3:20] * evelu (~erwan@37.165.117.113) Quit (Ping timeout: 480 seconds)
[3:26] * salwasser (~Adium@2601:197:800:6ea1:10e4:fc5:f18f:7582) Quit (Quit: Leaving.)
[3:29] * evelu (~erwan@2a01:e34:eecb:7400:4eeb:42ff:fedc:8ac) has joined #ceph
[3:31] * mnaser (~mnaser@162.253.53.193) has joined #ceph
[3:31] * terminalecho (~terminale@vanquish.cacr.caltech.edu) Quit (Quit: -NO CARRIER-)
[3:32] * davidzlap (~Adium@2605:e000:1313:8003:6066:d3ef:ff1c:3b58) has joined #ceph
[3:33] * Rickus (~Rickus@office.protected.ca) Quit (Read error: Connection reset by peer)
[3:33] * Rickus (~Rickus@office.protected.ca) has joined #ceph
[3:36] * Racpatel (~Racpatel@2601:87:3:31e3::3840) Quit (Quit: Leaving)
[3:51] * derjohn_mobi (~aj@x590dfd8f.dyn.telefonica.de) has joined #ceph
[3:51] * derjohn_mob (~aj@x4db0f8e6.dyn.telefonica.de) Quit (Read error: Connection reset by peer)
[3:57] * jfaj (~jan@p20030084AD3FB7016AF728FFFE6777FF.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[4:04] * linuxkidd (~linuxkidd@ip70-189-214-97.lv.lv.cox.net) Quit (Quit: Leaving)
[4:07] * jfaj (~jan@p20030084AD2C46006AF728FFFE6777FF.dip0.t-ipconnect.de) has joined #ceph
[4:09] * newdave (~newdave@36-209-181-180.cpe.skymesh.net.au) has joined #ceph
[4:09] * newdave_ (~newdave@36-209-181-180.cpe.skymesh.net.au) Quit (Read error: Connection reset by peer)
[4:14] * yanzheng (~zhyan@118.116.115.174) has joined #ceph
[4:20] * xarses (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) has joined #ceph
[4:21] * newdave_ (~newdave@36-209-181-180.cpe.skymesh.net.au) has joined #ceph
[4:28] * newdave (~newdave@36-209-181-180.cpe.skymesh.net.au) Quit (Ping timeout: 480 seconds)
[4:29] * kefu (~kefu@114.92.99.159) has joined #ceph
[4:37] * sankarshan (~sankarsha@125.16.34.66) has joined #ceph
[4:38] * sankarshan (~sankarsha@125.16.34.66) Quit ()
[4:42] * davidzlap (~Adium@2605:e000:1313:8003:6066:d3ef:ff1c:3b58) Quit (Quit: Leaving.)
[4:45] * valeech (~valeech@pool-96-247-203-33.clppva.fios.verizon.net) has joined #ceph
[4:47] * vicente (~~vicente@125-227-238-55.HINET-IP.hinet.net) has joined #ceph
[4:50] * kefu (~kefu@114.92.99.159) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[4:52] * DominikH (~Dominik_H@5.100.33.187.suec-dacor.de) has joined #ceph
[4:56] * Dominik_H (~Dominik_H@5.100.40.190.suec-dacor.de) Quit (Ping timeout: 480 seconds)
[5:08] * valeech (~valeech@pool-96-247-203-33.clppva.fios.verizon.net) Quit (Quit: valeech)
[5:10] * davidzlap (~Adium@rrcs-74-87-213-28.west.biz.rr.com) has joined #ceph
[5:11] * kefu (~kefu@114.92.99.159) has joined #ceph
[5:11] * kefu (~kefu@114.92.99.159) Quit ()
[5:13] * evelu (~erwan@2a01:e34:eecb:7400:4eeb:42ff:fedc:8ac) Quit (Ping timeout: 480 seconds)
[5:13] * kefu (~kefu@114.92.99.159) has joined #ceph
[5:14] * dlan (~dennis@116.228.88.131) Quit (Remote host closed the connection)
[5:14] * dlan (~dennis@116.228.88.131) has joined #ceph
[5:15] * kefu (~kefu@114.92.99.159) Quit ()
[5:17] * ngoswami (~ngoswami@121.244.87.116) Quit (Ping timeout: 480 seconds)
[5:17] * ngoswami (~ngoswami@121.244.87.116) has joined #ceph
[5:17] * bloatyfloat (~bloatyflo@46.37.172.253.srvlist.ukfast.net) Quit (Ping timeout: 480 seconds)
[5:19] * kefu (~kefu@114.92.99.159) has joined #ceph
[5:19] * kefu (~kefu@114.92.99.159) Quit ()
[5:21] * kefu (~kefu@114.92.99.159) has joined #ceph
[5:23] * kefu (~kefu@114.92.99.159) Quit ()
[5:24] * evelu (~erwan@2a01:e34:eecb:7400:4eeb:42ff:fedc:8ac) has joined #ceph
[5:27] * bloatyfloat (~bloatyflo@46.37.172.253) has joined #ceph
[5:29] * kefu (~kefu@114.92.99.159) has joined #ceph
[5:38] * georgem (~Adium@206.108.127.16) Quit (Quit: Leaving.)
[5:38] * Vacuum_ (~Vacuum@88.130.210.200) Quit (Read error: Connection reset by peer)
[5:38] * Vacuum_ (~Vacuum@88.130.206.181) has joined #ceph
[5:39] * kefu is now known as kefu|afk
[5:40] * kefu|afk (~kefu@114.92.99.159) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[5:42] * davidzlap (~Adium@rrcs-74-87-213-28.west.biz.rr.com) Quit (Quit: Leaving.)
[6:07] * jamespage (~jamespage@culvain.gromper.net) Quit (Read error: Connection reset by peer)
[6:08] * jamespage (~jamespage@culvain.gromper.net) has joined #ceph
[6:09] * wes_dillingham (~wes_dilli@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) Quit (Quit: wes_dillingham)
[6:10] * wes_dillingham (~wes_dilli@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) has joined #ceph
[6:10] * wes_dillingham (~wes_dilli@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) Quit ()
[6:28] * TomasCZ (~TomasCZ@yes.tenlab.net) Quit (Quit: Leaving)
[6:44] * ivve (~zed@cust-gw-11.se.zetup.net) has joined #ceph
[6:48] * madkiss (~madkiss@vpn146.sys11.net) has joined #ceph
[6:48] * madkiss (~madkiss@vpn146.sys11.net) has left #ceph
[7:04] * davidzlap (~Adium@rrcs-74-87-213-28.west.biz.rr.com) has joined #ceph
[7:04] * davidzlap (~Adium@rrcs-74-87-213-28.west.biz.rr.com) Quit ()
[7:11] * rdas (~rdas@121.244.87.116) has joined #ceph
[7:13] * Ramakrishnan (~ramakrish@125.16.34.66) has joined #ceph
[7:27] * lmb (~Lars@business-176-094-162-154.static.arcor-ip.net) has joined #ceph
[7:35] * nwe (~nwe@sigwait.se) has joined #ceph
[7:36] <nwe> hello, I will setup a ceph
[7:36] * evelu (~erwan@2a01:e34:eecb:7400:4eeb:42ff:fedc:8ac) Quit (Ping timeout: 480 seconds)
[7:39] * evelu (~erwan@2a01:e34:eecb:7400:4eeb:42ff:fedc:8ac) has joined #ceph
[7:40] <nwe> ceph-cluster, and have some question, the machines I have is like thie 4 * 185GB disk (2 disk in raid for OS) 1 disk for monitor and one disk for journal, I also have 6 * 750GB (all off them are SSD). what I know wondering if I should take all my 6 disks (750GB) and create a raid0 (hardware raid) and then add that to ceph-osd? or should I skip it map sdd -> ceph-osd, sde -> ceph-osd etc ? if I will do so will I
[7:40] <nwe> see them as one big storage or ? I will use ceph as storage for my kvm machines..
[7:43] * ivve (~zed@cust-gw-11.se.zetup.net) Quit (Ping timeout: 480 seconds)
[7:50] * vimal (~vikumar@121.244.87.116) has joined #ceph
[7:54] * lmb (~Lars@business-176-094-162-154.static.arcor-ip.net) Quit (Ping timeout: 480 seconds)
[8:01] * ivve (~zed@cust-gw-11.se.zetup.net) has joined #ceph
[8:02] * Kurt (~Adium@188-23-230-162.adsl.highway.telekom.at) has joined #ceph
[8:05] * Kurt (~Adium@188-23-230-162.adsl.highway.telekom.at) Quit ()
[8:05] * Kurt (~Adium@188-23-230-162.adsl.highway.telekom.at) has joined #ceph
[8:06] * Kurt (~Adium@188-23-230-162.adsl.highway.telekom.at) Quit ()
[8:06] <cetex> trust me
[8:07] <cetex> you don't want raid underneath ceph
[8:07] * Kurt (~Adium@188-23-230-162.adsl.highway.telekom.at) has joined #ceph
[8:08] * Be-El (~blinke@nat-router.computational.bio.uni-giessen.de) has joined #ceph
[8:09] * Kurt (~Adium@188-23-230-162.adsl.highway.telekom.at) Quit ()
[8:09] * Kurt (~Adium@188-23-230-162.adsl.highway.telekom.at) has joined #ceph
[8:11] <nwe> cetex: so I should map osd -> separate disk, and how will the "cluster" be will I see total diskspace in the pool?
[8:11] * Kurt (~Adium@188-23-230-162.adsl.highway.telekom.at) Quit ()
[8:11] * Kurt (~Adium@188-23-230-162.adsl.highway.telekom.at) has joined #ceph
[8:13] * Ramakrishnan (~ramakrish@125.16.34.66) Quit (Ping timeout: 480 seconds)
[8:13] <cetex> one osd per disk, cluster will show up as one single drive kinda
[8:17] * krypto (~krypto@125.16.137.146) has joined #ceph
[8:17] <nwe> cetex: okey, I will do like that
[8:17] * krypto (~krypto@125.16.137.146) Quit ()
[8:23] * derjohn_mobi (~aj@x590dfd8f.dyn.telefonica.de) Quit (Ping timeout: 480 seconds)
[8:27] * wgao (~wgao@106.120.101.38) Quit (Quit: Leaving)
[8:27] * wgao (~wgao@106.120.101.38) has joined #ceph
[8:28] * rakeshgm (~rakesh@125.16.34.66) has joined #ceph
[8:28] * ronrib (~oftc-webi@2400:8c80::505:45cd:67ce:9431:20e1) Quit (Remote host closed the connection)
[8:29] * wgao (~wgao@106.120.101.38) Quit ()
[8:29] * wgao (~wgao@106.120.101.38) has joined #ceph
[8:30] * Ramakrishnan (~ramakrish@125.16.34.66) has joined #ceph
[8:33] * KindOne (kindone@0001a7db.user.oftc.net) Quit (Remote host closed the connection)
[8:34] * lx0 (~aoliva@lxo.user.oftc.net) Quit (Ping timeout: 480 seconds)
[8:35] * webertrlz (~oftc-webi@191.185.28.83) Quit (Remote host closed the connection)
[8:36] * branto (~branto@transit-86-181-132-209.redhat.com) has joined #ceph
[8:38] <ivve> raid underneath ceph is kinda pointless
[8:39] * trololo (~cypher@fra06-3-78-243-232-119.fbx.proxad.net) has joined #ceph
[8:39] * T1w (~jens@node3.survey-it.dk) has joined #ceph
[8:40] * KindOne (kindone@0001a7db.user.oftc.net) has joined #ceph
[8:41] * ade (~abradshaw@pool-22.254.176.62.dynamic.wobline-ip.de) has joined #ceph
[8:50] * doppelgrau (~doppelgra@dslb-088-072-094-200.088.072.pools.vodafone-ip.de) has joined #ceph
[8:50] * hassifa (~kalleeen@108.61.122.51) has joined #ceph
[8:58] <peetaur2> ivve: how about on mons?
[9:00] * pdhange (~pdhange@61-69-103-54.mel.static-ipl.aapt.com.au) Quit (Quit: Leaving)
[9:02] * karnan (~karnan@125.16.34.66) has joined #ceph
[9:09] * Ramakrishnan (~ramakrish@125.16.34.66) Quit (Ping timeout: 480 seconds)
[9:16] * fsimonce (~simon@95.239.69.67) has joined #ceph
[9:17] * maybebuggy (~maybebugg@2a01:4f8:191:2350::2) has joined #ceph
[9:17] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[9:18] * doppelgrau (~doppelgra@dslb-088-072-094-200.088.072.pools.vodafone-ip.de) Quit (Quit: doppelgrau)
[9:20] * hassifa (~kalleeen@108.61.122.51) Quit ()
[9:25] * karnan (~karnan@125.16.34.66) Quit (Ping timeout: 480 seconds)
[9:31] * Ramakrishnan (~ramakrish@125.16.34.66) has joined #ceph
[9:33] <mistur> hello
[9:33] <mistur> I have a radosgw pool without bucket (all have been removed)
[9:33] * mhuang (~mhuang@42.120.74.111) has joined #ceph
[9:33] <mistur> I still have orphan object
[9:34] <mistur> radosgw-admin orphans find seem to be lock in a loop and never end
[9:35] <BranchPredictor> raid0 under osd may make sense if 1. you can afford 2x drives but not ssd, 2. i/o performance is a concern and 3. you'll use ceph for mostly large objects (>=1MB)
[9:35] <mistur> can I delete the pool and recreate it safely
[9:36] * rmart04 (~rmart04@support.memset.com) has joined #ceph
[9:37] * karnan (~karnan@125.16.34.66) has joined #ceph
[9:37] * analbeard (~shw@support.memset.com) has joined #ceph
[9:43] * evelu (~erwan@2a01:e34:eecb:7400:4eeb:42ff:fedc:8ac) Quit (Ping timeout: 480 seconds)
[9:48] * kutija (~kutija@89.216.27.139) has joined #ceph
[9:54] * evelu (~erwan@37.161.230.255) has joined #ceph
[10:01] * hbogert (~Adium@a83-163-87-95.adsl.xs4all.nl) has joined #ceph
[10:01] * hbogert1 (~Adium@a83-163-87-95.adsl.xs4all.nl) has joined #ceph
[10:08] * mhuang_ (~mhuang@42.120.74.88) has joined #ceph
[10:09] * hbogert (~Adium@a83-163-87-95.adsl.xs4all.nl) Quit (Ping timeout: 480 seconds)
[10:10] * doppelgrau (~doppelgra@132.252.235.172) has joined #ceph
[10:10] * mhuang (~mhuang@42.120.74.111) Quit (Ping timeout: 480 seconds)
[10:12] * Ramakrishnan (~ramakrish@125.16.34.66) Quit (Ping timeout: 480 seconds)
[10:13] * TMM (~hp@dhcp-077-248-009-229.chello.nl) Quit (Quit: Ex-Chat)
[10:15] * Ramakrishnan (~ramakrish@125.16.34.66) has joined #ceph
[10:20] * Jeffrey4l_ (~Jeffrey@110.252.63.58) Quit (Ping timeout: 480 seconds)
[10:20] * efirs (~firs@98.207.153.155) Quit (Quit: Leaving.)
[10:21] * Hemanth (~hkumar_@125.16.34.66) has joined #ceph
[10:27] * b0e (~aledermue@213.95.25.82) has joined #ceph
[10:30] * egi (~egi@83.220.237.120) has joined #ceph
[10:31] * rraja (~rraja@125.16.34.66) has joined #ceph
[10:31] * Ramakrishnan (~ramakrish@125.16.34.66) Quit (Ping timeout: 480 seconds)
[10:33] <egi> Hello, can someone tell me, is it possible to create diskless mds/mon image? I found article about creating diskless OSD, what about MDS and MON? https://www.redpill-linpro.com/sysadvent//2015/12/18/stateless-osd-servers.html
[10:36] <peetaur2> for performance, make sure mons have fast storage
[10:36] <peetaur2> but I imagine you can make it diskless ... or like osds, diskless os plus fast disk for mon
[10:41] <egi> So it is impossible to use mon without hdd? I ask because I have nodes with only 3 hdd per node. So I dont want to loose one hdd)
[10:43] * Jeffrey4l_ (~Jeffrey@110.252.44.217) has joined #ceph
[10:43] * Ramakrishnan (~ramakrish@125.16.34.66) has joined #ceph
[10:44] <egi> peetaur2, thank for your answer
[10:48] <peetaur2> I think you can do it, but mons do some sync writes that may slow things down, I have heard... don't know specifics
[10:49] <egi> peetaur2: thank you again) I will write here about results
[10:49] <peetaur2> np
[10:49] * egi (~egi@83.220.237.120) Quit (Quit: Leaving)
[10:51] <doppelgrau> funny idea, but since the mons need some (fast) and independent storage ...
[10:51] * DominikH (~Dominik_H@5.100.33.187.suec-dacor.de) Quit ()
[10:53] <doppelgrau> and putting the mon storade on rbd-devices .. :D
[10:58] * TMM (~hp@185.5.121.201) has joined #ceph
[10:58] <peetaur2> sounds like some infinite loop disk usage
[11:07] * nass51 (~fred@l-p-dn-in-12a.lionnois.site.univ-lorraine.fr) has joined #ceph
[11:07] * nass5 (~fred@l-p-dn-in-12a.lionnois.site.univ-lorraine.fr) Quit (Read error: Connection reset by peer)
[11:11] * wjw-freebsd (~wjw@smtp.digiware.nl) Quit (Ping timeout: 480 seconds)
[11:12] * rraja (~rraja@125.16.34.66) has left #ceph
[11:13] * rraja (~rraja@125.16.34.66) has joined #ceph
[11:13] * ItsCriminalAFK (~PeterRabb@5.63.151.156) has joined #ceph
[11:18] * mhuang_ (~mhuang@42.120.74.88) Quit (Quit: This computer has gone to sleep)
[11:20] * rotbeard (~redbeard@185.32.80.238) has joined #ceph
[11:21] * stiopa (~stiopa@cpc73832-dals21-2-0-cust453.20-2.cable.virginm.net) has joined #ceph
[11:24] <doppelgrau> :D
[11:24] <doppelgrau> I really like the dependencies, the mons need a running cluster for their storage, the cluster needs the mons for running
[11:25] <doppelgrau> It might even work, until a large powerfailure occeurs
[11:27] <peetaur2> I would think you'd have to start with normal mons, then replace with rbd mons at least..
[11:27] <peetaur2> and once it's down, you have to manually recover the mon files to start them again as normal mons again
[11:27] <peetaur2> if it didn't infinite loop with storage that is
[11:29] * flisky (~Thunderbi@106.38.61.190) has joined #ceph
[11:30] <doppelgrau> peetaur2: recovering the mon files in an offline cluster could be funny, if you like pain :D
[11:35] <peetaur2> do you have a good sized production cluster to try it on?
[11:36] <doppelgrau> sorry, have some other important tings to try, e.g building the eifel-tower from burned matches :D
[11:37] * ivve (~zed@cust-gw-11.se.zetup.net) Quit (Ping timeout: 480 seconds)
[11:40] * derjohn_mobi (~aj@b2b-94-79-172-98.unitymedia.biz) has joined #ceph
[11:42] <IcePic> I think I saw paint that wasnt all dry, I'll watch it.
[11:43] * ItsCriminalAFK (~PeterRabb@5.63.151.156) Quit ()
[11:51] * ivve (~zed@cust-gw-11.se.zetup.net) has joined #ceph
[11:55] * rinek (~o@62.109.134.112) Quit (Ping timeout: 480 seconds)
[11:55] * rinek (~o@62.109.134.112) has joined #ceph
[11:55] * erwan_taf (~erwan@aut78-1-78-236-183-64.fbx.proxad.net) has joined #ceph
[12:02] * evelu (~erwan@37.161.230.255) Quit (Ping timeout: 480 seconds)
[12:05] * flisky1 (~Thunderbi@106.38.61.188) has joined #ceph
[12:06] * flisky1 (~Thunderbi@106.38.61.188) Quit ()
[12:09] * flisky (~Thunderbi@106.38.61.190) Quit (Ping timeout: 480 seconds)
[12:11] * rinek (~o@62.109.134.112) Quit (Ping timeout: 480 seconds)
[12:11] * rinek (~o@62.109.134.112) has joined #ceph
[12:12] * Kurt (~Adium@188-23-230-162.adsl.highway.telekom.at) Quit (Ping timeout: 480 seconds)
[12:18] * rdas (~rdas@121.244.87.116) Quit (Quit: Leaving)
[12:24] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) has joined #ceph
[12:25] * newdave (~newdave@36-209-181-180.cpe.skymesh.net.au) has joined #ceph
[12:28] * Kurt (~Adium@188-23-230-162.adsl.highway.telekom.at) has joined #ceph
[12:31] * newdave_ (~newdave@36-209-181-180.cpe.skymesh.net.au) Quit (Ping timeout: 480 seconds)
[12:34] * Hau_MI is now known as hauM1
[12:37] * rotbeard (~redbeard@185.32.80.238) Quit (Quit: Leaving)
[12:38] * kutija (~kutija@89.216.27.139) Quit (Quit: Textual IRC Client: www.textualapp.com)
[12:43] * [0x4A6F]_ (~ident@p4FC26529.dip0.t-ipconnect.de) has joined #ceph
[12:45] * wes_dillingham (~wes_dilli@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) has joined #ceph
[12:45] * wes_dillingham (~wes_dilli@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) Quit ()
[12:46] * [0x4A6F] (~ident@0x4a6f.user.oftc.net) Quit (Ping timeout: 480 seconds)
[12:46] * [0x4A6F]_ is now known as [0x4A6F]
[12:46] * Blueraven (~anadrom@108.61.166.139) has joined #ceph
[12:48] * salwasser (~Adium@2601:197:800:6ea1:4986:ae21:cdf4:2318) has joined #ceph
[12:48] * salwasser (~Adium@2601:197:800:6ea1:4986:ae21:cdf4:2318) Quit ()
[12:50] * baotiao (~baotiao@218.30.116.3) has joined #ceph
[12:50] * bene2 (~bene@2601:193:4101:f410:ea2a:eaff:fe08:3c7a) has joined #ceph
[12:59] * libracious (~libraciou@catchpenny.cf) has joined #ceph
[12:59] * libracious (~libraciou@catchpenny.cf) has left #ceph
[13:06] * libracious (~libraciou@catchpenny.cf) has joined #ceph
[13:06] * vicente (~~vicente@125-227-238-55.HINET-IP.hinet.net) Quit (Quit: Leaving)
[13:07] * libracious (~libraciou@catchpenny.cf) has left #ceph
[13:14] * hbogert1 (~Adium@a83-163-87-95.adsl.xs4all.nl) Quit (Quit: Leaving.)
[13:16] * Blueraven (~anadrom@108.61.166.139) Quit ()
[13:17] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:e87c:2761:738e:5817) has joined #ceph
[13:19] * hbogert (~Adium@a83-163-87-95.adsl.xs4all.nl) has joined #ceph
[13:21] * bniver (~bniver@pool-71-174-250-171.bstnma.fios.verizon.net) Quit (Ping timeout: 480 seconds)
[13:29] * hbogert1 (~Adium@a83-163-87-95.adsl.xs4all.nl) has joined #ceph
[13:31] * hbogert (~Adium@a83-163-87-95.adsl.xs4all.nl) Quit (Ping timeout: 480 seconds)
[13:38] * Hemanth_ (~hkumar_@125.16.34.66) has joined #ceph
[13:38] * Hemanth (~hkumar_@125.16.34.66) Quit (Read error: Connection reset by peer)
[13:39] * diver_ (~diver@95.85.8.93) has joined #ceph
[13:43] * jcsp (~jspray@82-71-16-249.dsl.in-addr.zen.co.uk) has joined #ceph
[13:48] * MK_FG (~MK_FG@00018720.user.oftc.net) Quit (Ping timeout: 480 seconds)
[13:55] * ade (~abradshaw@pool-22.254.176.62.dynamic.wobline-ip.de) Quit (Quit: Too sexy for his shirt)
[13:56] * bniver (~bniver@71-9-144-29.static.oxfr.ma.charter.com) has joined #ceph
[13:59] <moegyver> hi! i was wondering if any of you know why i always see a max of 1500 IOPS on mapped rbd devices in linux with iostat no matter the cluster specs?
[13:59] <moegyver> not a problem, mainly curious
[13:59] <peetaur2> I tested 2800 or so with qemu
[14:00] <peetaur2> with fio... dunno what iostat said
[14:00] * valeech (~valeech@pool-96-247-203-33.clppva.fios.verizon.net) has joined #ceph
[14:01] <moegyver> when i use rbd without mapping them through the kernel i can see the iops per rbd scale with the size of the cluster
[14:01] <peetaur2> I'm not really even sure what you're saying... you mean the w/s for /dev/rbdxx device in iostat?
[14:02] <moegyver> but when i map it as a kernel device there is always an upper limit of 1500
[14:02] <moegyver> and yes w/s (or r/s) for the /dev/rbdX device
[14:03] <moegyver> might actually be around 1600 now that i think about it
[14:17] * rakeshgm (~rakesh@125.16.34.66) Quit (Ping timeout: 480 seconds)
[14:18] * rakeshgm (~rakesh@125.16.34.66) has joined #ceph
[14:18] <moegyver> ah, never mind the nic was maxed
[14:19] <moegyver> and i seem to have tested on the same type of nic every time
[14:19] <moegyver> stupid me
[14:19] <moegyver> sorry for the noise
[14:22] * JANorman (~JANorman@81.137.246.31) has joined #ceph
[14:23] * dlan (~dennis@116.228.88.131) Quit (Read error: Connection reset by peer)
[14:26] * baotiao (~baotiao@218.30.116.3) Quit (Quit: baotiao)
[14:26] * dlan (~dennis@116.228.88.131) has joined #ceph
[14:28] * Skyrider (~Rehevkor@37.203.209.2) has joined #ceph
[14:28] * georgem (~Adium@206.108.127.16) has joined #ceph
[14:29] * nardial (~ls@p5DC070E0.dip0.t-ipconnect.de) has joined #ceph
[14:29] * wes_dillingham (~wes_dilli@140.247.242.44) has joined #ceph
[14:30] * shaunm (~shaunm@ms-208-102-105-216.gsm.cbwireless.com) Quit (Ping timeout: 480 seconds)
[14:33] * rakeshgm (~rakesh@125.16.34.66) Quit (Remote host closed the connection)
[14:34] <peetaur2> for some reason my 2800 iops was down to only 1000, and now only 213 with the same test... and the ssd journals barely show any load... what happened?
[14:35] <peetaur2> rados bench -p rbd 10 write -b 4096 shows 1486 iops
[14:37] * MK_FG (~MK_FG@00018720.user.oftc.net) has joined #ceph
[14:38] <peetaur2> deleting all but 1 snapshot made it fast again at 1117 iops... and deleting the last snap makes it 1951 iops again. so ummmm I can't reasonably use snapshots then?
[14:46] * erwan_taf (~erwan@aut78-1-78-236-183-64.fbx.proxad.net) Quit (Ping timeout: 480 seconds)
[14:46] * erwan_taf (~erwan@2a01:e34:eecb:7400:4eeb:42ff:fedc:8ac) has joined #ceph
[14:48] * cristicalin (~cristical@109.166.154.147) has joined #ceph
[14:49] <cristicalin> is there a minimum version of qemu/libvirt required to use ceph cache tiering ?
[14:49] <cristicalin> when I enable cache tier on a pool my instances fail to boot or attach volumes
[14:50] * ivve (~zed@cust-gw-11.se.zetup.net) Quit (Ping timeout: 480 seconds)
[14:50] <cristicalin> qemu-img info works on the images but qemu fails to boot with "error reading header from volume-XYZ"
[14:51] * Racpatel (~Racpatel@2601:87:3:31e3::3840) has joined #ceph
[14:54] * karnan (~karnan@125.16.34.66) Quit (Quit: Leaving)
[14:58] * Skyrider (~Rehevkor@37.203.209.2) Quit ()
[15:02] <JANorman> Our second call to rados_write in an erasure coded pool (k=5 m=4) always returns operation not supported. I understand this is to with alignment. Can anyone clarify what we should do to write the second piece of data? https://gist.github.com/JANorman/e969a16edf2848edf2e5366da9ecc297
[15:02] * winmutt (~rolfmarti@199.33.145.32) has joined #ceph
[15:03] * mhack (~mhack@24-151-36-149.dhcp.nwtn.ct.charter.com) has joined #ceph
[15:08] * T1w (~jens@node3.survey-it.dk) Quit (Ping timeout: 480 seconds)
[15:10] * cristicalin (~cristical@109.166.154.147) Quit (Quit: Leaving...)
[15:15] * Kurt (~Adium@188-23-230-162.adsl.highway.telekom.at) Quit (Quit: Leaving.)
[15:19] * baotiao (~baotiao@43.255.178.233) has joined #ceph
[15:22] * baotiao (~baotiao@43.255.178.233) Quit ()
[15:26] * Kurt (~Adium@188-23-230-162.adsl.highway.telekom.at) has joined #ceph
[15:27] * shaunm (~shaunm@cpe-192-180-17-174.kya.res.rr.com) has joined #ceph
[15:28] <Gugge-47527> JANorman: how big is the first piece of data?
[15:31] * salwasser (~Adium@72.246.3.14) has joined #ceph
[15:32] <JANorman> Gugge-47527: In that gist, the data is 1byte. It's writing the same piece of data twice
[15:32] * WildyLio1 is now known as WildyLion
[15:36] * erwan_taf (~erwan@2a01:e34:eecb:7400:4eeb:42ff:fedc:8ac) Quit (Ping timeout: 480 seconds)
[15:39] * b0e (~aledermue@213.95.25.82) Quit (Quit: Leaving.)
[15:45] * yanzheng (~zhyan@118.116.115.174) Quit (Quit: This computer has gone to sleep)
[15:47] * erwan_taf (~erwan@37.161.230.255) has joined #ceph
[15:49] <Gugge-47527> JANorman: try writing a 5MB chunk, and see if you can append more then
[15:50] <Gugge-47527> im pretty sure 1byte not is alligned to a k=5 pool
[15:51] * yanzheng (~zhyan@118.116.115.174) has joined #ceph
[15:53] * rraja (~rraja@125.16.34.66) Quit (Quit: Leaving)
[15:56] * Ramakrishnan (~ramakrish@125.16.34.66) Quit (Quit: Leaving)
[15:58] <JANorman> Gugge-47527: Will try.
[15:59] * squizzi (~squizzi@107.13.237.240) has joined #ceph
[16:02] * mattbenjamin (~mbenjamin@174-23-175-206.slkc.qwest.net) has joined #ceph
[16:03] * Kurt (~Adium@188-23-230-162.adsl.highway.telekom.at) Quit (Quit: Leaving.)
[16:04] <winmutt> anyone having memory leaks with radosgw/civetweb?
[16:04] * wushudoin (~wushudoin@2601:646:8200:c9f0:2ab2:bdff:fe0b:a6ee) has joined #ceph
[16:06] * fauxhawk (~CobraKhan@178-175-128-50.static.host) has joined #ceph
[16:09] * branto (~branto@transit-86-181-132-209.redhat.com) Quit (Quit: ZNC 1.6.3 - http://znc.in)
[16:09] * wgao (~wgao@106.120.101.38) Quit (Ping timeout: 480 seconds)
[16:13] <JANorman> Gugge-47527: Writing 5MB twice (like before) is returning Operation not Supported on second write
[16:15] * Hemanth_ (~hkumar_@125.16.34.66) Quit (Ping timeout: 480 seconds)
[16:21] * haplo37 (~haplo37@107.190.42.94) has joined #ceph
[16:21] * johnavp1989 (~jpetrini@pool-100-14-10-2.phlapa.fios.verizon.net) has joined #ceph
[16:21] <- *johnavp1989* To prove that you are human, please enter the result of 8+3
[16:29] * treypalmer (~treypalme@199.33.145.32) has joined #ceph
[16:36] * fauxhawk (~CobraKhan@178-175-128-50.static.host) Quit ()
[16:43] * mattbenjamin (~mbenjamin@174-23-175-206.slkc.qwest.net) Quit (Ping timeout: 480 seconds)
[16:43] * johnavp1989 (~jpetrini@pool-100-14-10-2.phlapa.fios.verizon.net) Quit (Ping timeout: 480 seconds)
[16:47] * cmart (~cmart@ip68-226-23-16.tc.ph.cox.net) has joined #ceph
[16:55] * magicrobot (~oftc-webi@162.246.193.10) has joined #ceph
[16:55] <magicrobot> how do you see existing cache tiers in a cluster?
[16:56] * johnavp1989 (~jpetrini@8.39.115.8) has joined #ceph
[16:56] <- *johnavp1989* To prove that you are human, please enter the result of 8+3
[16:57] * maybebuggy (~maybebugg@2a01:4f8:191:2350::2) Quit (Remote host closed the connection)
[16:58] * vimal (~vikumar@121.244.87.116) Quit (Quit: Leaving)
[17:05] * analbeard (~shw@support.memset.com) Quit (Quit: Leaving.)
[17:07] * derjohn_mobi (~aj@b2b-94-79-172-98.unitymedia.biz) Quit (Ping timeout: 480 seconds)
[17:10] * eth00 (~eth00@74.81.187.100) Quit ()
[17:15] * TMM (~hp@185.5.121.201) Quit (Ping timeout: 480 seconds)
[17:16] * Kurt (~Adium@188-23-230-162.adsl.highway.telekom.at) has joined #ceph
[17:17] * ivve (~zed@c83-254-15-40.bredband.comhem.se) has joined #ceph
[17:18] * Kurt (~Adium@188-23-230-162.adsl.highway.telekom.at) Quit ()
[17:19] * davidzlap (~Adium@rrcs-74-87-213-28.west.biz.rr.com) has joined #ceph
[17:21] * briner (~briner@129.194.16.54) Quit (Quit: briner)
[17:23] * cmart (~cmart@ip68-226-23-16.tc.ph.cox.net) has left #ceph
[17:25] * ivve (~zed@c83-254-15-40.bredband.comhem.se) Quit (Ping timeout: 480 seconds)
[17:25] * rmart04 (~rmart04@support.memset.com) Quit (Quit: rmart04)
[17:28] * hbogert1 (~Adium@a83-163-87-95.adsl.xs4all.nl) Quit (Ping timeout: 480 seconds)
[17:29] * Alexey_Abashkin (~AlexeyAba@91.207.132.76) Quit (Read error: Connection reset by peer)
[17:30] * Alexey_Abashkin (~AlexeyAba@91.207.132.76) has joined #ceph
[17:36] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) Quit (Remote host closed the connection)
[17:36] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) has joined #ceph
[17:38] * Racpatel (~Racpatel@2601:87:3:31e3::3840) Quit (Remote host closed the connection)
[17:44] * doppelgrau (~doppelgra@132.252.235.172) Quit (Quit: Leaving.)
[17:45] * nardial (~ls@p5DC070E0.dip0.t-ipconnect.de) Quit (Quit: Leaving)
[17:47] * johnavp1989 (~jpetrini@8.39.115.8) Quit (Ping timeout: 480 seconds)
[17:48] * davidzlap (~Adium@rrcs-74-87-213-28.west.biz.rr.com) Quit (Quit: Leaving.)
[17:48] * newbie (~kvirc@host217-114-156-249.pppoe.mark-itt.net) has joined #ceph
[17:50] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) Quit (Ping timeout: 480 seconds)
[17:58] * ntpttr_ (~ntpttr@192.55.54.36) has joined #ceph
[18:00] * newbie (~kvirc@host217-114-156-249.pppoe.mark-itt.net) Quit (Ping timeout: 480 seconds)
[18:00] * sudocat (~dibarra@104-188-116-197.lightspeed.hstntx.sbcglobal.net) has joined #ceph
[18:02] * johnavp1989 (~jpetrini@pool-100-14-10-2.phlapa.fios.verizon.net) has joined #ceph
[18:02] <- *johnavp1989* To prove that you are human, please enter the result of 8+3
[18:05] * yanzheng (~zhyan@118.116.115.174) Quit (Quit: This computer has gone to sleep)
[18:05] * doppelgrau (~doppelgra@132.252.235.172) has joined #ceph
[18:08] * walcubi (~walcubi@p5099a7c3.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[18:09] * Be-El (~blinke@nat-router.computational.bio.uni-giessen.de) Quit (Quit: Leaving.)
[18:12] * Unai (~Adium@50-115-70-150.static-ip.telepacific.net) has joined #ceph
[18:13] * dgurtner (~dgurtner@178.197.224.178) has joined #ceph
[18:15] * sudocat (~dibarra@104-188-116-197.lightspeed.hstntx.sbcglobal.net) Quit (Ping timeout: 480 seconds)
[18:16] * Racpatel (~Racpatel@2601:87:3:31e3::3840) has joined #ceph
[18:19] * biGGer (~Thononain@185.108.128.10) has joined #ceph
[18:21] * Skaag (~lunix@65.200.54.234) has joined #ceph
[18:22] * circ-user-UV3CK (~circuser-@117.10.45.180) has joined #ceph
[18:24] * walcubi (~walcubi@p5099a7c3.dip0.t-ipconnect.de) has joined #ceph
[18:28] * sudocat (~dibarra@2602:306:8bc7:4c50:40ca:2ab0:d7c1:8712) has joined #ceph
[18:29] * guojian (~guojian@117.10.45.180) has joined #ceph
[18:30] * doppelgrau_ (~doppelgra@dslb-088-072-094-200.088.072.pools.vodafone-ip.de) has joined #ceph
[18:31] * xarses (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[18:32] * JANorman (~JANorman@81.137.246.31) Quit (Remote host closed the connection)
[18:32] * ntpttr_ (~ntpttr@192.55.54.36) Quit (Ping timeout: 480 seconds)
[18:35] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) has joined #ceph
[18:35] * biGGer (~Thononain@185.108.128.10) Quit (Ping timeout: 480 seconds)
[18:39] * trololo (~cypher@fra06-3-78-243-232-119.fbx.proxad.net) Quit (Ping timeout: 480 seconds)
[18:40] * guojian (~guojian@117.10.45.180) Quit (Remote host closed the connection)
[18:43] * xarses (~xarses@64.124.158.3) has joined #ceph
[18:46] * rmart04 (~rmart04@host109-157-171-8.range109-157.btcentralplus.com) has joined #ceph
[18:47] * davidzlap (~Adium@2605:e000:1313:8003:acb2:fa51:1859:798c) has joined #ceph
[18:47] * circ-user-UV3CK (~circuser-@117.10.45.180) Quit (Ping timeout: 480 seconds)
[18:48] * cyphase (~cyphase@000134f2.user.oftc.net) Quit (Ping timeout: 480 seconds)
[18:50] * davidzlap (~Adium@2605:e000:1313:8003:acb2:fa51:1859:798c) Quit ()
[18:56] * rmart04_ (~rmart04@support.memset.com) has joined #ceph
[18:59] * ivve (~zed@c83-254-15-40.bredband.comhem.se) has joined #ceph
[19:00] * rmart04 (~rmart04@host109-157-171-8.range109-157.btcentralplus.com) Quit (Ping timeout: 480 seconds)
[19:00] * rmart04_ is now known as rmart04
[19:01] <ledgr> ceph tell mds.2 injectargs '--mds-cache-size 1000000'
[19:01] <ledgr> mds_cache_size = '1000000' (unchangeable)
[19:01] <ledgr> anyone know how to overcome this without restarting mds?
[19:03] * mtanski_ (~mtanski@mobile-166-171-184-034.mycingular.net) has joined #ceph
[19:06] * JANorman (~JANorman@host31-48-185-156.range31-48.btcentralplus.com) has joined #ceph
[19:10] * ntpttr_ (~ntpttr@192.55.54.43) has joined #ceph
[19:12] * davidz (~davidz@2605:e000:1313:8003:d9a6:cbe6:13d1:59d3) has joined #ceph
[19:16] * lmb (~Lars@ip5b404bab.dynamic.kabel-deutschland.de) has joined #ceph
[19:18] * rmart04 (~rmart04@support.memset.com) Quit (Ping timeout: 480 seconds)
[19:19] * krogon (~krogon@irdmzpr01-ext.ir.intel.com) Quit (Read error: Connection reset by peer)
[19:20] * krogon (~krogon@192.198.151.44) has joined #ceph
[19:22] * JANorman (~JANorman@host31-48-185-156.range31-48.btcentralplus.com) Quit (Remote host closed the connection)
[19:25] * ledgr_ (~ledgr@84.15.179.100) has joined #ceph
[19:26] * ledgr_ (~ledgr@84.15.179.100) Quit (Remote host closed the connection)
[19:26] * ledgr_ (~ledgr@84.15.179.100) has joined #ceph
[19:29] * xinli (~charleyst@32.97.110.56) has joined #ceph
[19:31] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) Quit (Ping timeout: 480 seconds)
[19:33] * dgurtner (~dgurtner@178.197.224.178) Quit (Ping timeout: 480 seconds)
[19:33] * visored (~ggg@ns316491.ip-37-187-129.eu) has joined #ceph
[19:34] * ledgr_ (~ledgr@84.15.179.100) Quit (Ping timeout: 480 seconds)
[19:38] * cyphase (~cyphase@000134f2.user.oftc.net) has joined #ceph
[19:44] * krogon (~krogon@192.198.151.44) Quit (Read error: Connection reset by peer)
[19:45] * krogon (~krogon@irdmzpr01-ext.ir.intel.com) has joined #ceph
[19:45] * johnavp1989 (~jpetrini@pool-100-14-10-2.phlapa.fios.verizon.net) Quit (Ping timeout: 480 seconds)
[19:49] * lxo (~aoliva@lxo.user.oftc.net) Quit (Remote host closed the connection)
[19:49] * mtanski_ (~mtanski@mobile-166-171-184-034.mycingular.net) Quit (Read error: Connection reset by peer)
[19:50] * stiopa (~stiopa@cpc73832-dals21-2-0-cust453.20-2.cable.virginm.net) Quit (Ping timeout: 480 seconds)
[19:52] * Jeffrey4l_ (~Jeffrey@110.252.44.217) Quit (Remote host closed the connection)
[19:55] * johnavp1989 (~jpetrini@8.39.115.8) has joined #ceph
[19:55] <- *johnavp1989* To prove that you are human, please enter the result of 8+3
[19:56] * jarrpa (~jarrpa@63.225.131.166) Quit (Ping timeout: 480 seconds)
[19:57] <treypalmer> quit
[19:57] <treypalmer> exit
[19:57] * treypalmer (~treypalme@199.33.145.32) Quit (Quit: WeeChat 1.5)
[19:58] * haplo37 (~haplo37@107.190.42.94) Quit (Ping timeout: 480 seconds)
[20:00] * murmur (~murmur@zeeb.org) Quit (Ping timeout: 480 seconds)
[20:00] * xinli (~charleyst@32.97.110.56) Quit (Remote host closed the connection)
[20:00] * xinli (~charleyst@32.97.110.56) has joined #ceph
[20:01] * ledgr (~ledgr@84.15.179.100) has joined #ceph
[20:03] * visored (~ggg@ns316491.ip-37-187-129.eu) Quit ()
[20:03] * georgem1 (~Adium@206.108.127.16) has joined #ceph
[20:04] * jarrpa (~jarrpa@67-4-148-200.mpls.qwest.net) has joined #ceph
[20:05] * murmur (~murmur@zeeb.org) has joined #ceph
[20:05] * georgem (~Adium@206.108.127.16) Quit (Ping timeout: 480 seconds)
[20:05] * Hemanth (~hkumar_@27.34.248.223) has joined #ceph
[20:07] * brianjjo (~measter@46.166.148.152) has joined #ceph
[20:08] * winmutt (~rolfmarti@199.33.145.32) Quit (Ping timeout: 480 seconds)
[20:09] * ledgr (~ledgr@84.15.179.100) Quit (Ping timeout: 480 seconds)
[20:12] * vata (~vata@96.127.202.136) Quit (Quit: Leaving.)
[20:13] * cyphase (~cyphase@000134f2.user.oftc.net) Quit (Ping timeout: 480 seconds)
[20:14] * cyphase (~cyphase@000134f2.user.oftc.net) has joined #ceph
[20:16] * rdas (~rdas@121.244.87.113) has joined #ceph
[20:19] * ivve (~zed@c83-254-15-40.bredband.comhem.se) Quit (Ping timeout: 480 seconds)
[20:19] * xinli (~charleyst@32.97.110.56) Quit (Ping timeout: 480 seconds)
[20:20] <walcubi> Hmm, hit a strange error.
[20:20] <walcubi> ceph is complaining that there is no space left.
[20:21] <walcubi> df confirms that there is no space left, but btrfs said there's plenty.
[20:21] <walcubi> And using some gnu tool like cp shows that I can write new data on the disk without problems.
[20:21] <walcubi> So it is not full
[20:21] <walcubi> But ceph claims it is
[20:25] * TomasCZ (~TomasCZ@yes.tenlab.net) has joined #ceph
[20:27] <walcubi> Actually no, btrfs claims there is no space left
[20:27] <walcubi> If I run btrfs balance start
[20:27] <walcubi> But coreutils programs still work just fine. :)
[20:27] * erwan_taf (~erwan@37.161.230.255) Quit (Ping timeout: 480 seconds)
[20:27] <diver_> doing s3 stress test with kraken 11.0.1 (676cd2976f54cfebfb0612c57eb3a513034373dd) and bluestore - works great, 2M objects, 450 uploads\s
[20:28] <diver_> jewel died with 300M placed
[20:28] * cyphase (~cyphase@000134f2.user.oftc.net) Quit (Ping timeout: 480 seconds)
[20:29] <diver_> when I tried simulate drive replacement.. 20% in a week
[20:33] * hoonetorg (~hoonetorg@77.119.226.254.static.drei.at) Quit (Ping timeout: 480 seconds)
[20:37] * erwan_taf (~erwan@2a01:e34:eecb:7400:4eeb:42ff:fedc:8ac) has joined #ceph
[20:37] * ntpttr (~ntpttr@134.134.139.72) Quit (Read error: Connection reset by peer)
[20:37] * ntpttr (~ntpttr@192.55.54.40) has joined #ceph
[20:37] <walcubi> OK, I'm starting to remove files from the osd
[20:37] * brianjjo (~measter@46.166.148.152) Quit ()
[20:37] <walcubi> ceph has started up
[20:39] * rdas (~rdas@121.244.87.113) Quit (Quit: Leaving)
[20:40] * shaunm (~shaunm@cpe-192-180-17-174.kya.res.rr.com) Quit (Ping timeout: 480 seconds)
[20:41] * dgurtner (~dgurtner@84-73-130-19.dclient.hispeed.ch) has joined #ceph
[20:41] <walcubi> Oh wait, no, it crashed
[20:41] <walcubi> filestore(/var/lib/ceph/osd/ceph-25) mount initial op seq is 0; something is wrong
[20:43] * hoonetorg (~hoonetorg@fh.fh-joanneum.at) has joined #ceph
[20:43] * Discovery (~Discovery@109.235.52.3) has joined #ceph
[20:49] * ntpttr__ (~ntpttr@192.55.54.43) has joined #ceph
[20:49] * ntpttr_ (~ntpttr@192.55.54.43) Quit (Remote host closed the connection)
[20:50] * ntpttr_ (~ntpttr@192.55.54.43) has joined #ceph
[20:50] * ntpttr__ (~ntpttr@192.55.54.43) Quit (Remote host closed the connection)
[20:50] <Mosibi> walcubi: only one disk that's full(ish)?
[20:51] * JANorman (~JANorman@host31-48-185-156.range31-48.btcentralplus.com) has joined #ceph
[20:51] * JANorman (~JANorman@host31-48-185-156.range31-48.btcentralplus.com) Quit (Remote host closed the connection)
[20:51] <walcubi> It's not full
[20:52] * krypto (~krypto@G68-90-105-90.sbcis.sbc.com) has joined #ceph
[20:52] * JANorman (~JANorman@host31-48-185-156.range31-48.btcentralplus.com) has joined #ceph
[20:53] <Mosibi> walcubi: inode table full?
[20:56] <walcubi> Dynamically allocated.
[20:57] * ledgr (~ledgr@84.15.178.239) has joined #ceph
[20:58] * salwasser (~Adium@72.246.3.14) Quit (Quit: Leaving.)
[20:58] <walcubi> There should be 70GB unclaimed space on the disk anyway
[21:00] * georgem (~Adium@206.108.127.16) has joined #ceph
[21:00] * georgem1 (~Adium@206.108.127.16) Quit (Read error: Connection reset by peer)
[21:03] <Mosibi> walcubi: looks like a btrfs specific issue
[21:04] <Mosibi> walcubi: snapshot's maybe?
[21:04] * georgem (~Adium@206.108.127.16) Quit (Read error: Connection reset by peer)
[21:04] * georgem (~Adium@206.108.127.16) has joined #ceph
[21:04] <Mosibi> walcubi: this blog sums some btrfs full fs issues: http://marc.merlins.org/perso/btrfs/post_2014-05-04_Fixing-Btrfs-Filesystem-Full-Problems.html
[21:06] * ledgr (~ledgr@84.15.178.239) Quit (Ping timeout: 480 seconds)
[21:13] * derjohn_mobi (~aj@x590dfd8f.dyn.telefonica.de) has joined #ceph
[21:18] <walcubi> snapshots are disabled
[21:18] * KeeperOfTheSoul (~Grimmer@tor2r.ins.tor.net.eu.org) has joined #ceph
[21:18] <walcubi> I'm not falling for that awful feature. ;)
[21:19] <walcubi> I would start a balance
[21:19] <walcubi> But fails with "out of space"
[21:25] * JANorman (~JANorman@host31-48-185-156.range31-48.btcentralplus.com) Quit (Remote host closed the connection)
[21:25] * winmutt (~rolfmarti@199.33.145.32) has joined #ceph
[21:27] * JANorman (~JANorman@host31-48-185-156.range31-48.btcentralplus.com) has joined #ceph
[21:29] <Mosibi> walcubi: did you read that blog post?
[21:31] * vasu (~vasu@c-73-231-60-138.hsd1.ca.comcast.net) has joined #ceph
[21:32] <walcubi> Yeah
[21:32] <walcubi> Only the last item caught my attention
[21:32] <Mosibi> ack
[21:33] <walcubi> Created a loop device, added it to the disk
[21:33] <walcubi> balance is running
[21:33] <walcubi> Now, will ceph run...
[21:33] <Mosibi> cool
[21:37] * Hemanth (~hkumar_@27.34.248.223) Quit (Quit: Leaving)
[21:38] * JANorman (~JANorman@host31-48-185-156.range31-48.btcentralplus.com) Quit (Remote host closed the connection)
[21:39] * krypto (~krypto@G68-90-105-90.sbcis.sbc.com) Quit (Ping timeout: 480 seconds)
[21:41] * doppelgrau_ (~doppelgra@dslb-088-072-094-200.088.072.pools.vodafone-ip.de) Quit (Quit: doppelgrau_)
[21:48] * KeeperOfTheSoul (~Grimmer@tor2r.ins.tor.net.eu.org) Quit ()
[21:55] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) has joined #ceph
[21:55] * TMM (~hp@dhcp-077-248-009-229.chello.nl) has joined #ceph
[21:57] * wes_dillingham (~wes_dilli@140.247.242.44) Quit (Quit: wes_dillingham)
[21:58] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[21:59] * stiopa (~stiopa@cpc73832-dals21-2-0-cust453.20-2.cable.virginm.net) has joined #ceph
[22:05] * doppelgrau (~doppelgra@132.252.235.172) Quit (Quit: Leaving.)
[22:06] <walcubi> Great, it seems that things are fine when starting it up.
[22:07] * ntpttr_ (~ntpttr@192.55.54.43) Quit (Remote host closed the connection)
[22:07] <walcubi> Though in the proceed of mitigation, I copied a bunch of data off the osd
[22:07] <walcubi> And copying it back has reset all permissions from ceph to root
[22:08] * ntpttr_ (~ntpttr@134.134.139.76) has joined #ceph
[22:17] * winmutt (~rolfmarti@199.33.145.32) Quit (Ping timeout: 480 seconds)
[22:20] * ntpttr_ (~ntpttr@134.134.139.76) Quit (Remote host closed the connection)
[22:21] * georgem (~Adium@206.108.127.16) Quit (Quit: Leaving.)
[22:23] * dgurtner (~dgurtner@84-73-130-19.dclient.hispeed.ch) Quit (Ping timeout: 480 seconds)
[22:28] * shaunm (~shaunm@ms-208-102-105-216.gsm.cbwireless.com) has joined #ceph
[22:32] * ntpttr_ (~ntpttr@jfdmzpr06-ext.jf.intel.com) has joined #ceph
[22:36] * vata (~vata@96.127.202.136) has joined #ceph
[22:37] * lcurtis_ (~lcurtis@47.19.105.250) has joined #ceph
[22:39] * magicrobot (~oftc-webi@162.246.193.10) Quit (Remote host closed the connection)
[22:40] * JANorman (~JANorman@host31-48-185-156.range31-48.btcentralplus.com) has joined #ceph
[22:44] * erwan_taf (~erwan@2a01:e34:eecb:7400:4eeb:42ff:fedc:8ac) Quit (Ping timeout: 480 seconds)
[22:48] * bniver (~bniver@71-9-144-29.static.oxfr.ma.charter.com) Quit (Remote host closed the connection)
[22:48] * georgem (~Adium@2605:8d80:6a6:793:a88e:ce1f:a617:aee2) has joined #ceph
[22:50] * diver (~diver@216.85.162.34) has joined #ceph
[22:50] * diver_ (~diver@95.85.8.93) Quit (Read error: No route to host)
[22:51] * Grimmer (~homosaur@tor2r.ins.tor.net.eu.org) has joined #ceph
[22:52] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) Quit (Remote host closed the connection)
[22:52] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) has joined #ceph
[22:56] * Unai1 (~Adium@50-115-70-150.static-ip.telepacific.net) has joined #ceph
[22:56] * georgem (~Adium@2605:8d80:6a6:793:a88e:ce1f:a617:aee2) Quit (Quit: Leaving.)
[22:56] * Unai1 (~Adium@50-115-70-150.static-ip.telepacific.net) Quit ()
[22:56] * georgem (~Adium@206.108.127.16) has joined #ceph
[22:58] * diver (~diver@216.85.162.34) Quit (Ping timeout: 480 seconds)
[23:00] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) Quit (Ping timeout: 480 seconds)
[23:02] * Unai (~Adium@50-115-70-150.static-ip.telepacific.net) Quit (Ping timeout: 480 seconds)
[23:06] * ntpttr__ (~ntpttr@192.55.54.42) has joined #ceph
[23:06] * ntpttr_ (~ntpttr@jfdmzpr06-ext.jf.intel.com) Quit (Remote host closed the connection)
[23:11] * wes_dillingham (~wes_dilli@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) has joined #ceph
[23:15] * aarontc (~aarontc@2001:470:e893::1:1) Quit (Remote host closed the connection)
[23:16] * ntpttr__ (~ntpttr@192.55.54.42) Quit (Remote host closed the connection)
[23:17] * ntpttr_ (~ntpttr@192.55.54.42) has joined #ceph
[23:17] * erwan_taf (~erwan@2a01:e34:eecb:7400:4eeb:42ff:fedc:8ac) has joined #ceph
[23:18] * ivve (~zed@c83-254-15-40.bredband.comhem.se) has joined #ceph
[23:19] * aarontc (~aarontc@2001:470:e893::1:1) has joined #ceph
[23:21] * Grimmer (~homosaur@tor2r.ins.tor.net.eu.org) Quit ()
[23:21] * SEBI (~JohnO@108.61.122.215) has joined #ceph
[23:24] * mspinassi (~textual@64.124.157.9) has joined #ceph
[23:25] <mspinassi> Is anyone else having troubles downloading 10.2.3-1xenial from the repo?
[23:29] <mspinassi> amd64/Packages doesn't seem to have 10.2.3-1xenial anymore (I tried yesterday and was working fine)
[23:31] * ntpttr_ (~ntpttr@192.55.54.42) Quit (Remote host closed the connection)
[23:33] <bstillwell> It looks like the 10.2.3-1trusty packages were updated earlier today. Could be related.
[23:34] * cathode (~cathode@50-232-215-114-static.hfc.comcastbusiness.net) has joined #ceph
[23:35] * georgem (~Adium@206.108.127.16) Quit (Quit: Leaving.)
[23:35] <mspinassi> Yeap :(
[23:36] <mspinassi> Any repo maintainer here?
[23:37] * SEBI (~JohnO@108.61.122.215) Quit (Ping timeout: 480 seconds)
[23:40] * bene2 (~bene@2601:193:4101:f410:ea2a:eaff:fe08:3c7a) Quit (Quit: Konversation terminated!)
[23:42] <bstillwell> I just messaged Alfredo on the ML. I think it's related to him building the arm64 packages.
[23:46] * JANorman (~JANorman@host31-48-185-156.range31-48.btcentralplus.com) Quit (Remote host closed the connection)
[23:47] <mspinassi> Thanks bstillwell!
[23:54] * Racpatel (~Racpatel@2601:87:3:31e3::3840) Quit (Ping timeout: 480 seconds)

These logs were automatically created by CephLogBot on irc.oftc.net using the Java IRC LogBot.