123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367368369370371372373374375376377378379380381382383384385386387388389390391392393394395396397398399400401402403404405406407408409410411412413414415416417418419420421422423424425426427428429430431432433434435436437438439440441442443444445446447448449450451452453454455456457458459460461462463464465466467468469470471472473474475476477478479480481482483484485486487488489490491492493494495496497498499500501502503504505506507508509510511512513514515516517518519520521522523524525526527528529530531532533534535536537538539540541542543544545546547548549550551552553554555556557558559560561562563564565566567568569570571572573574575576577578579580581582583584585586587588589590591592593594595596597598599600601602603604605606607608609610611612613614615616617618619620621622623624625626627628629630631632633634635636637 |
- ==================
- Patch Decorators
- ==================
- .. currentmodule:: mock
- .. testsetup::
- class SomeClass(object):
- static_method = None
- class_method = None
- attribute = None
- sys.modules['package'] = package = Mock(name='package')
- sys.modules['package.module'] = package.module
- class TestCase(unittest2.TestCase):
- def run(self):
- result = unittest2.TestResult()
- super(unittest2.TestCase, self).run(result)
- assert result.wasSuccessful()
- .. testcleanup::
- patch.TEST_PREFIX = 'test'
- The patch decorators are used for patching objects only within the scope of
- the function they decorate. They automatically handle the unpatching for you,
- even if exceptions are raised. All of these functions can also be used in with
- statements or as class decorators.
- patch
- =====
- .. note::
- `patch` is straightforward to use. The key is to do the patching in the
- right namespace. See the section `where to patch`_.
- .. function:: patch(target, new=DEFAULT, spec=None, create=False, spec_set=None, autospec=None, new_callable=None, **kwargs)
- `patch` acts as a function decorator, class decorator or a context
- manager. Inside the body of the function or with statement, the `target`
- is patched with a `new` object. When the function/with statement exits
- the patch is undone.
- If `new` is omitted, then the target is replaced with a
- :class:`MagicMock`. If `patch` is used as a decorator and `new` is
- omitted, the created mock is passed in as an extra argument to the
- decorated function. If `patch` is used as a context manager the created
- mock is returned by the context manager.
- `target` should be a string in the form `'package.module.ClassName'`. The
- `target` is imported and the specified object replaced with the `new`
- object, so the `target` must be importable from the environment you are
- calling `patch` from. The target is imported when the decorated function
- is executed, not at decoration time.
- The `spec` and `spec_set` keyword arguments are passed to the `MagicMock`
- if patch is creating one for you.
- In addition you can pass `spec=True` or `spec_set=True`, which causes
- patch to pass in the object being mocked as the spec/spec_set object.
- `new_callable` allows you to specify a different class, or callable object,
- that will be called to create the `new` object. By default `MagicMock` is
- used.
- A more powerful form of `spec` is `autospec`. If you set `autospec=True`
- then the mock with be created with a spec from the object being replaced.
- All attributes of the mock will also have the spec of the corresponding
- attribute of the object being replaced. Methods and functions being mocked
- will have their arguments checked and will raise a `TypeError` if they are
- called with the wrong signature. For mocks
- replacing a class, their return value (the 'instance') will have the same
- spec as the class. See the :func:`create_autospec` function and
- :ref:`auto-speccing`.
- Instead of `autospec=True` you can pass `autospec=some_object` to use an
- arbitrary object as the spec instead of the one being replaced.
- By default `patch` will fail to replace attributes that don't exist. If
- you pass in `create=True`, and the attribute doesn't exist, patch will
- create the attribute for you when the patched function is called, and
- delete it again afterwards. This is useful for writing tests against
- attributes that your production code creates at runtime. It is off by by
- default because it can be dangerous. With it switched on you can write
- passing tests against APIs that don't actually exist!
- Patch can be used as a `TestCase` class decorator. It works by
- decorating each test method in the class. This reduces the boilerplate
- code when your test methods share a common patchings set. `patch` finds
- tests by looking for method names that start with `patch.TEST_PREFIX`.
- By default this is `test`, which matches the way `unittest` finds tests.
- You can specify an alternative prefix by setting `patch.TEST_PREFIX`.
- Patch can be used as a context manager, with the with statement. Here the
- patching applies to the indented block after the with statement. If you
- use "as" then the patched object will be bound to the name after the
- "as"; very useful if `patch` is creating a mock object for you.
- `patch` takes arbitrary keyword arguments. These will be passed to
- the `Mock` (or `new_callable`) on construction.
- `patch.dict(...)`, `patch.multiple(...)` and `patch.object(...)` are
- available for alternate use-cases.
- `patch` as function decorator, creating the mock for you and passing it into
- the decorated function:
- .. doctest::
- >>> @patch('__main__.SomeClass')
- ... def function(normal_argument, mock_class):
- ... print mock_class is SomeClass
- ...
- >>> function(None)
- True
- Patching a class replaces the class with a `MagicMock` *instance*. If the
- class is instantiated in the code under test then it will be the
- :attr:`~Mock.return_value` of the mock that will be used.
- If the class is instantiated multiple times you could use
- :attr:`~Mock.side_effect` to return a new mock each time. Alternatively you
- can set the `return_value` to be anything you want.
- To configure return values on methods of *instances* on the patched class
- you must do this on the `return_value`. For example:
- .. doctest::
- >>> class Class(object):
- ... def method(self):
- ... pass
- ...
- >>> with patch('__main__.Class') as MockClass:
- ... instance = MockClass.return_value
- ... instance.method.return_value = 'foo'
- ... assert Class() is instance
- ... assert Class().method() == 'foo'
- ...
- If you use `spec` or `spec_set` and `patch` is replacing a *class*, then the
- return value of the created mock will have the same spec.
- .. doctest::
- >>> Original = Class
- >>> patcher = patch('__main__.Class', spec=True)
- >>> MockClass = patcher.start()
- >>> instance = MockClass()
- >>> assert isinstance(instance, Original)
- >>> patcher.stop()
- The `new_callable` argument is useful where you want to use an alternative
- class to the default :class:`MagicMock` for the created mock. For example, if
- you wanted a :class:`NonCallableMock` to be used:
- .. doctest::
- >>> thing = object()
- >>> with patch('__main__.thing', new_callable=NonCallableMock) as mock_thing:
- ... assert thing is mock_thing
- ... thing()
- ...
- Traceback (most recent call last):
- ...
- TypeError: 'NonCallableMock' object is not callable
- Another use case might be to replace an object with a `StringIO` instance:
- .. doctest::
- >>> from StringIO import StringIO
- >>> def foo():
- ... print 'Something'
- ...
- >>> @patch('sys.stdout', new_callable=StringIO)
- ... def test(mock_stdout):
- ... foo()
- ... assert mock_stdout.getvalue() == 'Something\n'
- ...
- >>> test()
- When `patch` is creating a mock for you, it is common that the first thing
- you need to do is to configure the mock. Some of that configuration can be done
- in the call to patch. Any arbitrary keywords you pass into the call will be
- used to set attributes on the created mock:
- .. doctest::
- >>> patcher = patch('__main__.thing', first='one', second='two')
- >>> mock_thing = patcher.start()
- >>> mock_thing.first
- 'one'
- >>> mock_thing.second
- 'two'
- As well as attributes on the created mock attributes, like the
- :attr:`~Mock.return_value` and :attr:`~Mock.side_effect`, of child mocks can
- also be configured. These aren't syntactically valid to pass in directly as
- keyword arguments, but a dictionary with these as keys can still be expanded
- into a `patch` call using `**`:
- .. doctest::
- >>> config = {'method.return_value': 3, 'other.side_effect': KeyError}
- >>> patcher = patch('__main__.thing', **config)
- >>> mock_thing = patcher.start()
- >>> mock_thing.method()
- 3
- >>> mock_thing.other()
- Traceback (most recent call last):
- ...
- KeyError
- patch.object
- ============
- .. function:: patch.object(target, attribute, new=DEFAULT, spec=None, create=False, spec_set=None, autospec=None, new_callable=None, **kwargs)
- patch the named member (`attribute`) on an object (`target`) with a mock
- object.
- `patch.object` can be used as a decorator, class decorator or a context
- manager. Arguments `new`, `spec`, `create`, `spec_set`, `autospec` and
- `new_callable` have the same meaning as for `patch`. Like `patch`,
- `patch.object` takes arbitrary keyword arguments for configuring the mock
- object it creates.
- When used as a class decorator `patch.object` honours `patch.TEST_PREFIX`
- for choosing which methods to wrap.
- You can either call `patch.object` with three arguments or two arguments. The
- three argument form takes the object to be patched, the attribute name and the
- object to replace the attribute with.
- When calling with the two argument form you omit the replacement object, and a
- mock is created for you and passed in as an extra argument to the decorated
- function:
- .. doctest::
- >>> @patch.object(SomeClass, 'class_method')
- ... def test(mock_method):
- ... SomeClass.class_method(3)
- ... mock_method.assert_called_with(3)
- ...
- >>> test()
- `spec`, `create` and the other arguments to `patch.object` have the same
- meaning as they do for `patch`.
- patch.dict
- ==========
- .. function:: patch.dict(in_dict, values=(), clear=False, **kwargs)
- Patch a dictionary, or dictionary like object, and restore the dictionary
- to its original state after the test.
- `in_dict` can be a dictionary or a mapping like container. If it is a
- mapping then it must at least support getting, setting and deleting items
- plus iterating over keys.
- `in_dict` can also be a string specifying the name of the dictionary, which
- will then be fetched by importing it.
- `values` can be a dictionary of values to set in the dictionary. `values`
- can also be an iterable of `(key, value)` pairs.
- If `clear` is True then the dictionary will be cleared before the new
- values are set.
- `patch.dict` can also be called with arbitrary keyword arguments to set
- values in the dictionary.
- `patch.dict` can be used as a context manager, decorator or class
- decorator. When used as a class decorator `patch.dict` honours
- `patch.TEST_PREFIX` for choosing which methods to wrap.
- `patch.dict` can be used to add members to a dictionary, or simply let a test
- change a dictionary, and ensure the dictionary is restored when the test
- ends.
- .. doctest::
- >>> from mock import patch
- >>> foo = {}
- >>> with patch.dict(foo, {'newkey': 'newvalue'}):
- ... assert foo == {'newkey': 'newvalue'}
- ...
- >>> assert foo == {}
- >>> import os
- >>> with patch.dict('os.environ', {'newkey': 'newvalue'}):
- ... print os.environ['newkey']
- ...
- newvalue
- >>> assert 'newkey' not in os.environ
- Keywords can be used in the `patch.dict` call to set values in the dictionary:
- .. doctest::
- >>> mymodule = MagicMock()
- >>> mymodule.function.return_value = 'fish'
- >>> with patch.dict('sys.modules', mymodule=mymodule):
- ... import mymodule
- ... mymodule.function('some', 'args')
- ...
- 'fish'
- `patch.dict` can be used with dictionary like objects that aren't actually
- dictionaries. At the very minimum they must support item getting, setting,
- deleting and either iteration or membership test. This corresponds to the
- magic methods `__getitem__`, `__setitem__`, `__delitem__` and either
- `__iter__` or `__contains__`.
- .. doctest::
- >>> class Container(object):
- ... def __init__(self):
- ... self.values = {}
- ... def __getitem__(self, name):
- ... return self.values[name]
- ... def __setitem__(self, name, value):
- ... self.values[name] = value
- ... def __delitem__(self, name):
- ... del self.values[name]
- ... def __iter__(self):
- ... return iter(self.values)
- ...
- >>> thing = Container()
- >>> thing['one'] = 1
- >>> with patch.dict(thing, one=2, two=3):
- ... assert thing['one'] == 2
- ... assert thing['two'] == 3
- ...
- >>> assert thing['one'] == 1
- >>> assert list(thing) == ['one']
- patch.multiple
- ==============
- .. function:: patch.multiple(target, spec=None, create=False, spec_set=None, autospec=None, new_callable=None, **kwargs)
- Perform multiple patches in a single call. It takes the object to be
- patched (either as an object or a string to fetch the object by importing)
- and keyword arguments for the patches::
- with patch.multiple(settings, FIRST_PATCH='one', SECOND_PATCH='two'):
- ...
- Use :data:`DEFAULT` as the value if you want `patch.multiple` to create
- mocks for you. In this case the created mocks are passed into a decorated
- function by keyword, and a dictionary is returned when `patch.multiple` is
- used as a context manager.
- `patch.multiple` can be used as a decorator, class decorator or a context
- manager. The arguments `spec`, `spec_set`, `create`, `autospec` and
- `new_callable` have the same meaning as for `patch`. These arguments will
- be applied to *all* patches done by `patch.multiple`.
- When used as a class decorator `patch.multiple` honours `patch.TEST_PREFIX`
- for choosing which methods to wrap.
- If you want `patch.multiple` to create mocks for you, then you can use
- :data:`DEFAULT` as the value. If you use `patch.multiple` as a decorator
- then the created mocks are passed into the decorated function by keyword.
- .. doctest::
- >>> thing = object()
- >>> other = object()
- >>> @patch.multiple('__main__', thing=DEFAULT, other=DEFAULT)
- ... def test_function(thing, other):
- ... assert isinstance(thing, MagicMock)
- ... assert isinstance(other, MagicMock)
- ...
- >>> test_function()
- `patch.multiple` can be nested with other `patch` decorators, but put arguments
- passed by keyword *after* any of the standard arguments created by `patch`:
- .. doctest::
- >>> @patch('sys.exit')
- ... @patch.multiple('__main__', thing=DEFAULT, other=DEFAULT)
- ... def test_function(mock_exit, other, thing):
- ... assert 'other' in repr(other)
- ... assert 'thing' in repr(thing)
- ... assert 'exit' in repr(mock_exit)
- ...
- >>> test_function()
- If `patch.multiple` is used as a context manager, the value returned by the
- context manger is a dictionary where created mocks are keyed by name:
- .. doctest::
- >>> with patch.multiple('__main__', thing=DEFAULT, other=DEFAULT) as values:
- ... assert 'other' in repr(values['other'])
- ... assert 'thing' in repr(values['thing'])
- ... assert values['thing'] is thing
- ... assert values['other'] is other
- ...
- .. _start-and-stop:
- patch methods: start and stop
- =============================
- All the patchers have `start` and `stop` methods. These make it simpler to do
- patching in `setUp` methods or where you want to do multiple patches without
- nesting decorators or with statements.
- To use them call `patch`, `patch.object` or `patch.dict` as normal and keep a
- reference to the returned `patcher` object. You can then call `start` to put
- the patch in place and `stop` to undo it.
- If you are using `patch` to create a mock for you then it will be returned by
- the call to `patcher.start`.
- .. doctest::
- >>> patcher = patch('package.module.ClassName')
- >>> from package import module
- >>> original = module.ClassName
- >>> new_mock = patcher.start()
- >>> assert module.ClassName is not original
- >>> assert module.ClassName is new_mock
- >>> patcher.stop()
- >>> assert module.ClassName is original
- >>> assert module.ClassName is not new_mock
- A typical use case for this might be for doing multiple patches in the `setUp`
- method of a `TestCase`:
- .. doctest::
- >>> class MyTest(TestCase):
- ... def setUp(self):
- ... self.patcher1 = patch('package.module.Class1')
- ... self.patcher2 = patch('package.module.Class2')
- ... self.MockClass1 = self.patcher1.start()
- ... self.MockClass2 = self.patcher2.start()
- ...
- ... def tearDown(self):
- ... self.patcher1.stop()
- ... self.patcher2.stop()
- ...
- ... def test_something(self):
- ... assert package.module.Class1 is self.MockClass1
- ... assert package.module.Class2 is self.MockClass2
- ...
- >>> MyTest('test_something').run()
- .. caution::
- If you use this technique you must ensure that the patching is "undone" by
- calling `stop`. This can be fiddlier than you might think, because if an
- exception is raised in the setUp then tearDown is not called. `unittest2
- <http://pypi.python.org/pypi/unittest2>`_ cleanup functions make this
- easier.
- .. doctest::
- >>> class MyTest(TestCase):
- ... def setUp(self):
- ... patcher = patch('package.module.Class')
- ... self.MockClass = patcher.start()
- ... self.addCleanup(patcher.stop)
- ...
- ... def test_something(self):
- ... assert package.module.Class is self.MockClass
- ...
- >>> MyTest('test_something').run()
- As an added bonus you no longer need to keep a reference to the `patcher`
- object.
- It is also possible to stop all patches which have been started by using
- `patch.stopall`.
- .. function:: patch.stopall
- Stop all active patches. Only stops patches started with `start`.
- TEST_PREFIX
- ===========
- All of the patchers can be used as class decorators. When used in this way
- they wrap every test method on the class. The patchers recognise methods that
- start with `test` as being test methods. This is the same way that the
- `unittest.TestLoader` finds test methods by default.
- It is possible that you want to use a different prefix for your tests. You can
- inform the patchers of the different prefix by setting `patch.TEST_PREFIX`:
- .. doctest::
- >>> patch.TEST_PREFIX = 'foo'
- >>> value = 3
- >>>
- >>> @patch('__main__.value', 'not three')
- ... class Thing(object):
- ... def foo_one(self):
- ... print value
- ... def foo_two(self):
- ... print value
- ...
- >>>
- >>> Thing().foo_one()
- not three
- >>> Thing().foo_two()
- not three
- >>> value
- 3
- Nesting Patch Decorators
- ========================
- If you want to perform multiple patches then you can simply stack up the
- decorators.
- You can stack up multiple patch decorators using this pattern:
- .. doctest::
- >>> @patch.object(SomeClass, 'class_method')
- ... @patch.object(SomeClass, 'static_method')
- ... def test(mock1, mock2):
- ... assert SomeClass.static_method is mock1
- ... assert SomeClass.class_method is mock2
- ... SomeClass.static_method('foo')
- ... SomeClass.class_method('bar')
- ... return mock1, mock2
- ...
- >>> mock1, mock2 = test()
- >>> mock1.assert_called_once_with('foo')
- >>> mock2.assert_called_once_with('bar')
- Note that the decorators are applied from the bottom upwards. This is the
- standard way that Python applies decorators. The order of the created mocks
- passed into your test function matches this order.
- Like all context-managers patches can be nested using contextlib's nested
- function; *every* patching will appear in the tuple after "as":
- .. doctest::
- >>> from contextlib import nested
- >>> with nested(
- ... patch('package.module.ClassName1'),
- ... patch('package.module.ClassName2')
- ... ) as (MockClass1, MockClass2):
- ... assert package.module.ClassName1 is MockClass1
- ... assert package.module.ClassName2 is MockClass2
- ...
- .. _where-to-patch:
- Where to patch
- ==============
- `patch` works by (temporarily) changing the object that a *name* points to with
- another one. There can be many names pointing to any individual object, so
- for patching to work you must ensure that you patch the name used by the system
- under test.
- The basic principle is that you patch where an object is *looked up*, which
- is not necessarily the same place as where it is defined. A couple of
- examples will help to clarify this.
- Imagine we have a project that we want to test with the following structure::
- a.py
- -> Defines SomeClass
- b.py
- -> from a import SomeClass
- -> some_function instantiates SomeClass
- Now we want to test `some_function` but we want to mock out `SomeClass` using
- `patch`. The problem is that when we import module b, which we will have to
- do then it imports `SomeClass` from module a. If we use `patch` to mock out
- `a.SomeClass` then it will have no effect on our test; module b already has a
- reference to the *real* `SomeClass` and it looks like our patching had no
- effect.
- The key is to patch out `SomeClass` where it is used (or where it is looked up
- ). In this case `some_function` will actually look up `SomeClass` in module b,
- where we have imported it. The patching should look like:
- `@patch('b.SomeClass')`
- However, consider the alternative scenario where instead of `from a import
- SomeClass` module b does `import a` and `some_function` uses `a.SomeClass`. Both
- of these import forms are common. In this case the class we want to patch is
- being looked up on the a module and so we have to patch `a.SomeClass` instead:
- `@patch('a.SomeClass')`
- Patching Descriptors and Proxy Objects
- ======================================
- Since version 0.6.0 both patch_ and patch.object_ have been able to correctly
- patch and restore descriptors: class methods, static methods and properties.
- You should patch these on the *class* rather than an instance.
- Since version 0.7.0 patch_ and patch.object_ work correctly with some objects
- that proxy attribute access, like the `django setttings object
- <http://www.voidspace.org.uk/python/weblog/arch_d7_2010_12_04.shtml#e1198>`_.
- .. note::
- In django `import settings` and `from django.conf import settings`
- return different objects. If you are using libraries / apps that do both you
- may have to patch both. Grrr...
|