Skip to content

crush: update weights properly for DAG (not tree) maps #105

Closed
liewegas wants to merge 93 commits intowip-crushfrom
master
Closed

crush: update weights properly for DAG (not tree) maps #105
liewegas wants to merge 93 commits intowip-crushfrom
master

Conversation

@liewegas
Copy link
Member

No description provided.

dotnwat and others added 30 commits March 8, 2013 17:49
Avoid referencing non-installed header deps.

Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
Signed-off-by: Andras Elso <elso.andras@gmail.com>
If the mon_host line has an IP twice, we shouldn't crash.

Signed-off-by: Sage Weil <sage@inktank.com>
The --signal argument to Debian's start-stop-daemon doesn't
make it send a signal, but defines which signal should be send
when --stop is specified.

Signed-off-by: Jan Harkes <jaharkes@cs.cmu.edu>
Signed-off-by: Jan Harkes <jaharkes@cs.cmu.edu>
Fixes for RadosGW init script

Reviewed-by: Sage Weil <sage@inktank.com>
…llect

Fixes: #4256

Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
Reviewed-by: Sage Weil <sage@inktank.com>
This increase only means that we'll keep more versions around before we
trim.  It doesn't change the number of versions we'll keep around after
trimming (that's still as much as 'paxos_max_join_drift', i.e. 10), nor
does it change the criteria used to consider a monitor as having drifted
(same rule applies, 'paxos_max_join_drift').

This change however will enable the leader to put off trimming for a longer
period of time, giving a better chance for a monitor to join the cluster.
See, after going through the probing phase, at which point a monitor may
only be, say, 5 versions off, the same monitor may end up getting into the
quorum only to find that in-between probing and finally triggering an
election some 6 versions might have come to existence.  Before this patch,
by then the state had been trimmed and the monitor would have to bootstrap
to perform a full store sync.  With this patch in place, the monitor would
be able to sync the remaining 11 versions.

Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
Reviewed-by: Sage Weil <sage@inktank.com>
This reverts commit a99ed03.

On second thought, this will require a bit more care to ensure that all
of the paths radosgw needs to read/write from have the correct permissions
in the packages and so forth.

Signed-off-by: Sage Weil <sage@inktank.com>
Reads always use C_ReadFinish as a callback (and they are the only
user of this callback). Keep an xlist of these for each object, so
they can remove themselves as they finish. To prevent racing requests
and with discard removing objects from the cache, clear the xlist in
the object destructor, so if the Object is still valid the set_item
will still be on the list.

Make the ObjectCacher constructor take an Object* instead of the pool
and object id, which are derived from the Object* anyway.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
Clear the exists and complete flags for any objects that have exists
set to false, and force any in-flight reads to retry if they get
-ENOENT instead of generating zeros.

This is useful for getting the cache into a consistent state for rbd
after an image has been flattened, since many objects which previously
did not exist and went up to the parent to retrieve data may now exist
in the child.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
The cache stores which objects don't exist. Flatten bypasses the cache
when doing its copyups, so when it is done the -ENOENT from the cache
is treated as zeroes instead of 'need to read from parent'.

Clients that have the image open need to forgot about the cached
non-existent objects as well. Do this during ictx_refresh, while the
parent_lock is held exclusively so no new reads from the parent can
happen until the updated parent metadata is visible, so no new reads
from the parent will occur.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
Use less memory.

Signed-off-by: Sage Weil <sage@inktank.com>
Fixes: #4384
Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Sage Weil <sage.weil@inktank.com>
…path

There is no reason not to rely on the default or obey any configured
value here.

Fixes: #4031
Signed-off-by: Sage Weil <sage@inktank.com>
No reason to override the default or configured value here.

Signed-off-by: Sage Weil <sage@inktank.com>
The hadoop-internal-tests workunit needs
to be updated in light of our moving to
using stock Hadoop with our hadoop-cephfs
jars.

Signed-off-by: Joe Buck <jbbuck@gmail.com>
Signed-off-by: Joe Buck <jbbuck@gmail.com>
Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
…list

Perform initialization of IntentLogNameFilter:prefix in initialization list
instead of constructor body.

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
Sage Weil added 18 commits March 13, 2013 16:36
Signed-off-by: Sage Weil <sage@inktank.com>
Removing remaining lookups up the mds inst in the MDSMap.  Instead, use
the MetaSession inst field.

Signed-off-by: Sage Weil <sage@inktank.com>
This moves us to a cleaner API, and makes the session lifetime explicit
and clean.  Yay!

Signed-off-by: Sage Weil <sage@inktank.com>
Signed-off-by: Sage Weil <sage@inktank.com>
Signed-off-by: Sage Weil <sage@inktank.com>
Signed-off-by: Sage Weil <sage@inktank.com>
For every message handler, look up the MetaSession by int mds and verify
that the Connection* matches properly.  If so, proceed; otherwise, discard
the message.

In the future, we probably want to link the MetaSession to the Connection's
priv field, but that can come later.

Clean up a bunch of submethods that take int mds while we're here.

Signed-off-by: Sage Weil <sage@inktank.com>
Signed-off-by: Sage Weil <sage@inktank.com>
Signed-off-by: Sage Weil <sage@inktank.com>
Signed-off-by: Sage Weil <sage@inktank.com>
Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Greg Farnum <greg@inktank.com>
Use the Connection ref to mark old client sessions down.  This is cleaner.

Signed-off-by: Sage Weil <sage@inktank.com>
Signed-off-by: Sage Weil <sage@inktank.com>
If there is a fault while delivering the message, close the con.  This will
clean up the Session state from memory.  If the client doesn't get the
CLOSED message, they will reconnect (from their perspective, it is still
a lossless connection) and get a remote_reset event telling them that the
session is gone.  The client code already handles this case properly.

Note that way back in 4ac4520 we removed
this because the client would reuse the same connection when it reopened
the session.  Now the client never does that; it will mark_down the con
as soon as it is closed and open a new one for a new session... which means
the MDS will get a remote_reset and close out the old session.

Signed-off-by: Sage Weil <sage@inktank.com>
Signed-off-by: Sage Weil <sage@inktank.com>
Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Greg Farnum <greg@inktank.com>
Tested-by: Noah Watkins <jayhawk@cs.ucsc.edu>
@liewegas
Copy link
Member Author

grr, wrong way

@liewegas liewegas closed this Mar 13, 2013
chamdoo pushed a commit to chamdoo/ceph that referenced this pull request Nov 13, 2015
liewegas pushed a commit that referenced this pull request Dec 14, 2016
tasks/s3tests: push boto config with idle_timeout setting
ddiss added a commit to ddiss/ceph that referenced this pull request Apr 27, 2017
rgw: use a vector for options passed to civetweb
Devp00l pushed a commit to Devp00l/ceph that referenced this pull request Feb 21, 2018
mgr/dashboard_v2: Data transform in k/v table
liewegas pushed a commit to liewegas/ceph that referenced this pull request Nov 5, 2021
ansible: Add youtube to nginx CSP
andriytk pushed a commit to andriytk/cortx-rgw that referenced this pull request Mar 3, 2022
* Fix for CORTX-28869:Unable to create IAM user with email

* Enable create user for same UID under different Tenant with motr as backend. (ceph#90)
andriytk pushed a commit to andriytk/cortx-rgw that referenced this pull request Mar 17, 2022
* Fix for CORTX-28869:Unable to create IAM user with email

* Enable create user for same UID under different Tenant with motr as backend. (ceph#90)
andriytk pushed a commit to andriytk/cortx-rgw that referenced this pull request Apr 1, 2022
Delete email entry from email index during user deletion

Signed-off-by: Sanal Kaarthikeyan <sanal.kaarthikeyan@seagate.com>
galsalomon66 referenced this pull request in galsalomon66/ceph Sep 17, 2022
* s3select: json tests
Signed-off-by: Albin Antony <aantony@redhat.com>

* the append in sql_execution causes a kind of duplication. the append should happen on run_json_query, between calls to JSON handler(the handler may keep rows, that should be flush before publishing the results)
Signed-off-by: gal salomon <gal.salomon@gmail.com>

* fix presto error
Signed-off-by: Albin Antony <aantony@redhat.com>

Signed-off-by: Albin Antony <aantony@redhat.com>
Signed-off-by: gal salomon <gal.salomon@gmail.com>
Co-authored-by: gal salomon <gal.salomon@gmail.com>
Moisi pushed a commit to Moisi/ceph that referenced this pull request Jun 30, 2025
Merge in STORAGEENG/ceph from CEPH-231-404-after-multipart-complete-18 to aka_version_18.2.1

* commit '874d96e3a6949324545e78cd1dab83862dd1c3d6':
  CEPH-231-18 fix 404 when multi-part complete
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

10 participants