auxiliary - common functions and objects¶
Math¶
linear_regression_vertical()- a wrapper for NumPy linear regression, minimizes the sum of squares of y errors.
linear_regression()- alias forlinear_regression_vertical().
linear_regression_perpendicular()- a wrapper for NumPy linear regression, minimizes the sum of squares of (perpendicular) distances between the points and the line.
Target-Decoy Approach¶
qvalues()- estimate q-values for a set of PSMs.
filter()- filter PSMs to specified FDR level using TDA or given PEPs.
filter.chain()- a chained version offilter().
fdr()- estimate FDR in a set of PSMs using TDA or given PEPs.
Project infrastructure¶
PyteomicsError- a pyteomics-specific exception.
Helpers¶
Charge- a subclass ofintfor charge states.
ChargeList- a subclass oflistfor lists of charges.
print_tree()- display the structure of a complex nesteddict.
memoize()- makes a memoization function decorator.
cvquery()- traverse an arbitrarily nested dictionary looking for keys which arecvstrinstances, or objects with an attribute calledaccession.
- pyteomics.auxiliary.math.linear_regression(x, y=None, a=None, b=None)[source]¶
Alias of
linear_regression_vertical().
- pyteomics.auxiliary.math.linear_regression_perpendicular(x, y=None)[source]¶
Calculate coefficients of a linear regression y = a * x + b. The fit minimizes perpendicular distances between the points and the line.
Requires
numpy.- Parameters:
- Returns:
out – The structure is (a, b, r, stderr), where a – slope coefficient, b – free term, r – Peason correlation coefficient, stderr – standard deviation.
- Return type:
4-tuple of float
- pyteomics.auxiliary.math.linear_regression_vertical(x, y=None, a=None, b=None)[source]¶
Calculate coefficients of a linear regression y = a * x + b. The fit minimizes vertical distances between the points and the line.
Requires
numpy.- Parameters:
x (array_like of float) – 1-D arrays of floats. If y is omitted, x must be a 2-D array of shape (N, 2).
y (array_like of float) – 1-D arrays of floats. If y is omitted, x must be a 2-D array of shape (N, 2).
a (float, optional) – If specified then the slope coefficient is fixed and equals a.
b (float, optional) – If specified then the free term is fixed and equals b.
- Returns:
out – The structure is (a, b, r, stderr), where a – slope coefficient, b – free term, r – Peason correlation coefficient, stderr – standard deviation.
- Return type:
4-tuple of float
- pyteomics.auxiliary.target_decoy.fdr(psms=None, formula=1, is_decoy=None, ratio=1, correction=0, pep=None, decoy_prefix='DECOY_', decoy_suffix=None)¶
Estimate FDR of a data set using TDA or given PEP values. Two formulas can be used. The first one (default) is:
\[FDR = \frac{N_{decoy}}{N_{target} * ratio}\]The second formula is:
\[FDR = \frac{N_{decoy} * (1 + \frac{1}{ratio})}{N_{total}}\]Note
This function is less versatile than
qvalues(). To obtain FDR, you can callqvalues()and take the last q-value. This function can be used (with correction = 0 or 1) whennumpyis not available.- Parameters:
psms (iterable, optional) – An iterable of PSMs, e.g. as returned by
read(). Not needed if is_decoy is an iterable.formula (int, optional) – Can be either 1 or 2, defines which formula should be used for FDR estimation. Default is 1.
is_decoy (callable, iterable, or str) –
If callable, should accept exactly one argument (PSM) and return a truthy value if the PSM is considered decoy. Default is
is_decoy(). If array-like, should contain float values for all given PSMs. If string, it is used as a field name (PSMs must be in a record array or apandas.DataFrame).Warning
The default function may not work with your files, because format flavours are diverse.
decoy_prefix (str, optional) – If the default is_decoy function works for you, this parameter specifies which protein name prefix to use to detect decoy matches. If you provide your own is_decoy, or if you specify decoy_suffix, this parameter has no effect. Default is “DECOY_”.
decoy_suffix (str, optional) – If the default is_decoy function works for you, this parameter specifies which protein name suffix to use to detect decoy matches. If you provide your own is_decoy, this parameter has no effect. Mutually exclusive with decoy_prefix.
pep (callable, iterable, or str, optional) –
If callable, a function used to determine the posterior error probability (PEP). Should accept exactly one argument (PSM) and return a float. If array-like, should contain float values for all given PSMs. If string, it is used as a field name (PSMs must be in a record array or a
pandas.DataFrame).Note
If this parameter is given, then PEP values will be used to calculate FDR. Otherwise, decoy PSMs will be used instead. This option conflicts with: is_decoy, formula, ratio, correction.
ratio (float, optional) – The size ratio between the decoy and target databases. Default is 1. In theory, the “size” of the database is the number of theoretical peptides eligible for assignment to spectra that are produced by in silico cleavage of that database.
correction (int or float, optional) –
Possible values are 0, 1 and 2, or floating point numbers between 0 and 1.
0 (default): no correction;
1: enable “+1” correction. This accounts for the probability that a false positive scores better than the first excluded decoy PSM;
2: this also corrects that probability for finite size of the sample, so the correction will be slightly less than “+1”.
If a floating point number is given, then instead of the expectation value for the number of false PSMs, the confidence value is used. The value of correction is then interpreted as desired confidence level. E.g., if correction=0.95, then the calculated q-values do not exceed the “real” q-values with 95% probability.
See this paper for further explanation.
Note
Requires
numpy, if correction is a float or 2.Note
Correction is only needed if the PSM set at hand was obtained using TDA filtering based on decoy counting (as done by using
filter()without correction).
- Returns:
out – The estimation of FDR, (roughly) between 0 and 1.
- Return type:
- pyteomics.auxiliary.target_decoy.filter(*args, **kwargs)¶
Read args and yield only the PSMs that form a set with estimated false discovery rate (FDR) not exceeding fdr.
Requires
numpyand, optionally,pandas.- Parameters:
args (positional) – Files to read PSMs from. All positional arguments are treated as files. The rest of the arguments must be named.
fdr (float, keyword only, 0 <= fdr <= 1) – Desired FDR level.
key (callable / array-like / iterable / str, keyword only) –
A function used for sorting of PSMs. Should accept exactly one argument (PSM) and return a number (the smaller the better). The default is a function that tries to extract e-value from the PSM.
Warning
The default function may not work with your files, because format flavours are diverse.
reverse (bool, keyword only, optional) – If
True, then PSMs are sorted in descending order, i.e. the value of the key function is higher for better PSMs. Default isFalse.is_decoy (callable / array-like / iterable / str, keyword only) –
A function used to determine if the PSM is decoy or not. Should accept exactly one argument (PSM) and return a truthy value if the PSM should be considered decoy.
Warning
The default function may not work with your files, because format flavours are diverse.
decoy_prefix (str, optional) – If the default is_decoy function works for you, this parameter specifies which protein name prefix to use to detect decoy matches. If you provide your own is_decoy, or if you specify decoy_suffix, this parameter has no effect. Default is “DECOY_”.
decoy_suffix (str, optional) – If the default is_decoy function works for you, this parameter specifies which protein name suffix to use to detect decoy matches. If you provide your own is_decoy, this parameter has no effect. Mutually exclusive with decoy_prefix.
remove_decoy (bool, keyword only, optional) –
Defines whether decoy matches should be removed from the output. Default is
True.Note
If set to
False, then by default the decoy PSMs will be taken into account when estimating FDR. Refer to the documentation offdr()for math; basically, if remove_decoy isTrue, then formula 1 is used to control output FDR, otherwise it’s formula 2. This can be changed by overriding the formula argument.formula (int, keyword only, optional) – Can be either 1 or 2, defines which formula should be used for FDR estimation. Default is 1 if remove_decoy is
True, else 2 (seefdr()for definitions).ratio (float, keyword only, optional) – The size ratio between the decoy and target databases. Default is 1. In theory, the “size” of the database is the number of theoretical peptides eligible for assignment to spectra that are produced by in silico cleavage of that database.
correction (int or float, keyword only, optional) –
Possible values are 0, 1 and 2, or floating point numbers between 0 and 1.
0 (default): no correction;
1: enable “+1” correction. This accounts for the probability that a false positive scores better than the first excluded decoy PSM;
2: this also corrects that probability for finite size of the sample, so the correction will be slightly less than “+1”.
If a floating point number is given, then instead of the expectation value for the number of false PSMs, the confidence value is used. The value of correction is then interpreted as desired confidence level. E.g., if correction=0.95, then the calculated q-values do not exceed the “real” q-values with 95% probability.
See this paper for further explanation.
pep (callable / array-like / iterable / str, keyword only, optional) –
If callable, a function used to determine the posterior error probability (PEP). Should accept exactly one argument (PSM) and return a float. If array-like, should contain float values for all given PSMs. If string, it is used as a field name (PSMs must be in a record array or a
DataFrame).Note
If this parameter is given, then PEP values will be used to calculate q-values. Otherwise, decoy PSMs will be used instead. This option conflicts with: is_decoy, remove_decoy, formula, ratio, correction. key can still be provided. Without key, PSMs will be sorted by PEP.
full_output (bool, keyword only, optional) –
If
True, then an array of PSM objects is returned. Otherwise, an iterator / context manager object is returned, and the files are parsed twice. This saves some RAM, but is ~2x slower. Default isTrue.Note
The name for the parameter comes from the fact that it is internally passed to
qvalues().q_label (str, optional) – Field name for q-value in the output. Default is
'q'.score_label (str, optional) – Field name for score in the output. Default is
'score'.decoy_label (str, optional) – Field name for the decoy flag in the output. Default is
'is decoy'.pep_label (str, optional) – Field name for PEP in the output. Default is
'PEP'.**kwargs (passed to the
chain()function.)
- Returns:
out
- Return type:
iterator or
numpy.ndarrayorpandas.DataFrame
- pyteomics.auxiliary.target_decoy.qvalues(*args, **kwargs)¶
Read args and return a NumPy array with scores and q-values. q-values are calculated either using TDA or based on provided values of PEP.
Requires
numpy(and optionallypandas).- Parameters:
args (positional) – Files to read PSMs from. All positional arguments are treated as files. The rest of the arguments must be named.
key (callable / array-like / iterable / str, keyword only) –
If callable, a function used for sorting of PSMs. Should accept exactly one argument (PSM) and return a number (the smaller the better). If array-like, should contain scores for all given PSMs. If string, it is used as a field name (PSMs must be in a record array or a
DataFrame).Warning
The default function may not work with your files, because format flavours are diverse.
reverse (bool, keyword only, optional) – If
True, then PSMs are sorted in descending order, i.e. the value of the key function is higher for better PSMs. Default isFalse.is_decoy (callable / array-like / iterable / str, keyword only) –
If callable, a function used to determine if the PSM is decoy or not. Should accept exactly one argument (PSM) and return a truthy value if the PSM should be considered decoy. If array-like, should contain boolean values for all given PSMs. If string, it is used as a field name (PSMs must be in a record array or a
DataFrame).Warning
The default function may not work with your files, because format flavours are diverse.
decoy_prefix (str, optional) – If the default is_decoy function works for you, this parameter specifies which protein name prefix to use to detect decoy matches. If you provide your own is_decoy, or if you specify decoy_suffix, this parameter has no effect. Default is “DECOY_”.
decoy_suffix (str, optional) – If the default is_decoy function works for you, this parameter specifies which protein name suffix to use to detect decoy matches. If you provide your own is_decoy, this parameter has no effect. Mutually exclusive with decoy_prefix.
pep (callable / array-like / iterable / str, keyword only, optional) –
If callable, a function used to determine the posterior error probability (PEP). Should accept exactly one argument (PSM) and return a float. If array-like, should contain float values for all given PSMs. If string, it is used as a field name (PSMs must be in a record array or a
DataFrame).Note
If this parameter is given, then PEP values will be used to calculate q-values. Otherwise, decoy PSMs will be used instead. This option conflicts with: is_decoy, remove_decoy, formula, ratio, correction. key can still be provided. Without key, PSMs will be sorted by PEP.
remove_decoy (bool, keyword only, optional) –
Defines whether decoy matches should be removed from the output. Default is
False.Note
If set to
False, then by default the decoy PSMs will be taken into account when estimating FDR. Refer to the documentation offdr()for math; basically, if remove_decoy isTrue, then formula 1 is used to control output FDR, otherwise it’s formula 2. This can be changed by overriding the formula argument.formula (int, keyword only, optional) – Can be either 1 or 2, defines which formula should be used for FDR estimation. Default is 1 if remove_decoy is
True, else 2 (seefdr()for definitions).ratio (float, keyword only, optional) – The size ratio between the decoy and target databases. Default is 1. In theory, the “size” of the database is the number of theoretical peptides eligible for assignment to spectra that are produced by in silico cleavage of that database.
correction (int or float, keyword only, optional) –
Possible values are 0, 1 and 2, or floating point numbers between 0 and 1.
0 (default): no correction;
1: enable “+1” correction. This accounts for the probability that a false positive scores better than the first excluded decoy PSM;
2: this also corrects that probability for finite size of the sample, so the correction will be slightly less than “+1”.
If a floating point number is given, then instead of the expectation value for the number of false PSMs, the confidence value is used. The value of correction is then interpreted as desired confidence level. E.g., if correction=0.95, then the calculated q-values do not exceed the “real” q-values with 95% probability.
See this paper for further explanation.
q_label (str, optional) – Field name for q-value in the output. Default is
'q'.score_label (str, optional) – Field name for score in the output. Default is
'score'.decoy_label (str, optional) – Field name for the decoy flag in the output. Default is
'is decoy'.pep_label (str, optional) – Field name for PEP in the output. Default is
'PEP'.full_output (bool, keyword only, optional) – If
True, then the returned array has PSM objects along with scores and q-values. Default isFalse.**kwargs (passed to the
chain()function.)
- Returns:
out – A sorted array of records with the following fields:
’score’:
np.float64’is decoy’:
np.bool_’q’:
np.float64’psm’:
np.object_(if full_output isTrue)
- Return type:
numpy.ndarray
- pyteomics.auxiliary.target_decoy.sigma_T(psms, is_decoy, ratio=1)[source]¶
Calculates the standard error for the number of false positive target PSMs.
The formula is:
.. math ::
sigma(T) = sqrt{frac{(d + 1) cdot {p}}{(1 - p)^{2}}} = sqrt{frac{d+1}{r^{2}} cdot (r+1)}
This estimation is accurate for low FDRs. See the article for more details.
- pyteomics.auxiliary.target_decoy.sigma_fdr(psms=None, formula=1, is_decoy=None, ratio=1)[source]¶
Calculates the standard error of FDR using the formula for negative binomial distribution. See
sigma_T()for math. This estimation is accurate for low FDRs. See also the article for more details.
- class pyteomics.auxiliary.utils.BinaryArrayConversionMixin(*args, **kwargs)[source]¶
Bases:
ArrayConversionMixin,BinaryDataArrayTransformer- __init__(*args, **kwargs)¶
- class binary_array_record(data, compression, dtype, source, key)¶
Bases:
binary_array_recordHold all of the information about a base64 encoded array needed to decode the array.
- __init__()¶
- compression¶
Alias for field number 1
- count(value, /)¶
Return number of occurrences of value.
- data¶
Alias for field number 0
- dtype¶
Alias for field number 2
- index(value, start=0, stop=9223372036854775807, /)¶
Return first index of value.
Raises ValueError if the value is not present.
- key¶
Alias for field number 4
- source¶
Alias for field number 3
- decode_data_array(source, compression_type=None, dtype=<class 'numpy.float64'>)¶
Decode a base64-encoded, compressed bytestring into a numerical array.
- Parameters:
- Return type:
np.ndarray
- class pyteomics.auxiliary.utils.BinaryDataArrayTransformer[source]¶
Bases:
objectA base class that provides methods for reading base64-encoded binary arrays.
- __init__()¶
- class binary_array_record(data, compression, dtype, source, key)[source]¶
Bases:
binary_array_recordHold all of the information about a base64 encoded array needed to decode the array.
- __init__()¶
- compression¶
Alias for field number 1
- count(value, /)¶
Return number of occurrences of value.
- data¶
Alias for field number 0
- dtype¶
Alias for field number 2
- index(value, start=0, stop=9223372036854775807, /)¶
Return first index of value.
Raises ValueError if the value is not present.
- key¶
Alias for field number 4
- source¶
Alias for field number 3
- pyteomics.auxiliary.utils.add_metaclass(metaclass)[source]¶
Class decorator for creating a class with a metaclass.
- pyteomics.auxiliary.utils.ensure_url_prefix(path_or_url)[source]¶
Ensure that a string path has a URL schema prefix, add “file://” if it is missing. Only expects a subset of URL schemes that can be urlopen-ed for reading.
- pyteomics.auxiliary.utils.memoize(maxsize=1000)[source]¶
Make a memoization decorator. A negative value of maxsize means no size limit.
- pyteomics.auxiliary.utils.print_tree(d, indent_str=' -> ', indent_count=1)[source]¶
Read a nested dict (with strings as keys) and print its structure.
- class pyteomics.auxiliary.structures.BasicComposition(*args, **kwargs)[source]¶
Bases:
defaultdict,CounterA generic dictionary for compositions. Keys should be strings, values should be integers. Allows simple arithmetics.
- clear()¶
Remove all items from the dict.
- default_factory¶
Factory for default value called by __missing__().
- elements()¶
Iterator over elements repeating each as many times as its count.
>>> c = Counter('ABCABC') >>> sorted(c.elements()) ['A', 'A', 'B', 'B', 'C', 'C']
Knuth’s example for prime factors of 1836: 2**2 * 3**3 * 17**1
>>> import math >>> prime_factors = Counter({2: 2, 3: 3, 17: 1}) >>> math.prod(prime_factors.elements()) 1836
Note, if an element’s count has been set to zero or is a negative number, elements() will ignore it.
- classmethod fromkeys(iterable, v=None)¶
Create a new dictionary with keys from iterable and values set to value.
- get(key, default=None, /)¶
Return the value for key if key is in the dictionary, else default.
- items()¶
Return a set-like object providing a view on the dict’s items.
- keys()¶
Return a set-like object providing a view on the dict’s keys.
- most_common(n=None)¶
List the n most common elements and their counts from the most common to the least. If n is None, then list all element counts.
>>> Counter('abracadabra').most_common(3) [('a', 5), ('b', 2), ('r', 2)]
- pop(k[, d]) v, remove specified key and return the corresponding value.¶
If the key is not found, return the default if given; otherwise, raise a KeyError.
- popitem()¶
Remove and return a (key, value) pair as a 2-tuple.
Pairs are returned in LIFO (last-in, first-out) order. Raises KeyError if the dict is empty.
- setdefault(key, default=None, /)¶
Insert key with a value of default if key is not in the dictionary.
Return the value for key if key is in the dictionary, else default.
- subtract(iterable=None, /, **kwds)¶
Like dict.update() but subtracts counts instead of replacing them. Counts can be reduced below zero. Both the inputs and outputs are allowed to contain zero and negative counts.
Source can be an iterable, a dictionary, or another Counter instance.
>>> c = Counter('which') >>> c.subtract('witch') # subtract elements from another iterable >>> c.subtract(Counter('watch')) # subtract elements from another counter >>> c['h'] # 2 in which, minus 1 in witch, minus 1 in watch 0 >>> c['w'] # 1 in which, minus 1 in witch, minus 1 in watch -1
- total()¶
Sum of the counts
- update(iterable=None, /, **kwds)¶
Like dict.update() but add counts instead of replacing them.
Source can be an iterable, a dictionary, or another Counter instance.
>>> c = Counter('which') >>> c.update('witch') # add elements from another iterable >>> d = Counter('watch') >>> c.update(d) # add elements from another counter >>> c['h'] # four 'h' in which, witch, and watch 4
- values()¶
Return an object providing a view on the dict’s values.
- class pyteomics.auxiliary.structures.Charge(*args, **kwargs)[source]¶
Bases:
intA subclass of
int. Can be constructed from strings in “N+” or “N-” format, and the string representation of aChargeis also in that format.- __init__()¶
- as_integer_ratio()¶
Return a pair of integers, whose ratio is equal to the original int.
The ratio is in lowest terms and has a positive denominator.
>>> (10).as_integer_ratio() (10, 1) >>> (-10).as_integer_ratio() (-10, 1) >>> (0).as_integer_ratio() (0, 1)
- bit_count()¶
Number of ones in the binary representation of the absolute value of self.
Also known as the population count.
>>> bin(13) '0b1101' >>> (13).bit_count() 3
- bit_length()¶
Number of bits necessary to represent self in binary.
>>> bin(37) '0b100101' >>> (37).bit_length() 6
- conjugate()¶
Returns self, the complex conjugate of any int.
- denominator¶
the denominator of a rational number in lowest terms
- classmethod from_bytes(bytes, byteorder='big', *, signed=False)¶
Return the integer represented by the given array of bytes.
- bytes
Holds the array of bytes to convert. The argument must either support the buffer protocol or be an iterable object producing bytes. Bytes and bytearray are examples of built-in objects that support the buffer protocol.
- byteorder
The byte order used to represent the integer. If byteorder is ‘big’, the most significant byte is at the beginning of the byte array. If byteorder is ‘little’, the most significant byte is at the end of the byte array. To request the native byte order of the host system, use sys.byteorder as the byte order value. Default is to use ‘big’.
- signed
Indicates whether two’s complement is used to represent the integer.
- imag¶
the imaginary part of a complex number
- is_integer()¶
Returns True. Exists for duck type compatibility with float.is_integer.
- numerator¶
the numerator of a rational number in lowest terms
- real¶
the real part of a complex number
- to_bytes(length=1, byteorder='big', *, signed=False)¶
Return an array of bytes representing an integer.
- length
Length of bytes object to use. An OverflowError is raised if the integer is not representable with the given number of bytes. Default is length 1.
- byteorder
The byte order used to represent the integer. If byteorder is ‘big’, the most significant byte is at the beginning of the byte array. If byteorder is ‘little’, the most significant byte is at the end of the byte array. To request the native byte order of the host system, use sys.byteorder as the byte order value. Default is to use ‘big’.
- signed
Determines whether two’s complement is used to represent the integer. If signed is False and a negative integer is given, an OverflowError is raised.
- class pyteomics.auxiliary.structures.ChargeList(*args, **kwargs)[source]¶
Bases:
listJust a list of :py:class:`Charge`s. When printed, looks like an enumeration of the list contents. Can also be constructed from such strings (e.g. “2+, 3+ and 4+”).
- append(object, /)¶
Append object to the end of the list.
- clear()¶
Remove all items from list.
- copy()¶
Return a shallow copy of the list.
- count(value, /)¶
Return number of occurrences of value.
- extend(iterable, /)¶
Extend list by appending elements from the iterable.
- index(value, start=0, stop=9223372036854775807, /)¶
Return first index of value.
Raises ValueError if the value is not present.
- insert(index, object, /)¶
Insert object before index.
- pop(index=-1, /)¶
Remove and return item at index (default last).
Raises IndexError if list is empty or index is out of range.
- remove(value, /)¶
Remove first occurrence of value.
Raises ValueError if the value is not present.
- reverse()¶
Reverse IN PLACE.
- sort(*, key=None, reverse=False)¶
Sort the list in ascending order and return None.
The sort is in-place (i.e. the list itself is modified) and stable (i.e. the order of two equal elements is maintained).
If a key function is given, apply it once to each list item and sort them, ascending or descending, according to their function values.
The reverse flag can be set to sort in descending order.
- class pyteomics.auxiliary.structures.Ion(*args, **kwargs)[source]¶
Bases:
strRepresents an Ion, right now just a subclass of String.
- capitalize()¶
Return a capitalized version of the string.
More specifically, make the first character have upper case and the rest lower case.
- casefold()¶
Return a version of the string suitable for caseless comparisons.
- center(width, fillchar=' ', /)¶
Return a centered string of length width.
Padding is done using the specified fill character (default is a space).
- count()¶
Return the number of non-overlapping occurrences of substring sub in string S[start:end].
Optional arguments start and end are interpreted as in slice notation.
- encode(encoding='utf-8', errors='strict')¶
Encode the string using the codec registered for encoding.
- encoding
The encoding in which to encode the string.
- errors
The error handling scheme to use for encoding errors. The default is ‘strict’ meaning that encoding errors raise a UnicodeEncodeError. Other possible values are ‘ignore’, ‘replace’ and ‘xmlcharrefreplace’ as well as any other name registered with codecs.register_error that can handle UnicodeEncodeErrors.
- endswith()¶
Return True if the string ends with the specified suffix, False otherwise.
- suffix
A string or a tuple of strings to try.
- start
Optional start position. Default: start of the string.
- end
Optional stop position. Default: end of the string.
- expandtabs(tabsize=8)¶
Return a copy where all tab characters are expanded using spaces.
If tabsize is not given, a tab size of 8 characters is assumed.
- find()¶
Return the lowest index in S where substring sub is found, such that sub is contained within S[start:end].
Optional arguments start and end are interpreted as in slice notation. Return -1 on failure.
- format(*args, **kwargs)¶
Return a formatted version of the string, using substitutions from args and kwargs. The substitutions are identified by braces (‘{’ and ‘}’).
- format_map(mapping, /)¶
Return a formatted version of the string, using substitutions from mapping. The substitutions are identified by braces (‘{’ and ‘}’).
- index()¶
Return the lowest index in S where substring sub is found, such that sub is contained within S[start:end].
Optional arguments start and end are interpreted as in slice notation. Raises ValueError when the substring is not found.
- isalnum()¶
Return True if the string is an alpha-numeric string, False otherwise.
A string is alpha-numeric if all characters in the string are alpha-numeric and there is at least one character in the string.
- isalpha()¶
Return True if the string is an alphabetic string, False otherwise.
A string is alphabetic if all characters in the string are alphabetic and there is at least one character in the string.
- isascii()¶
Return True if all characters in the string are ASCII, False otherwise.
ASCII characters have code points in the range U+0000-U+007F. Empty string is ASCII too.
- isdecimal()¶
Return True if the string is a decimal string, False otherwise.
A string is a decimal string if all characters in the string are decimal and there is at least one character in the string.
- isdigit()¶
Return True if the string is a digit string, False otherwise.
A string is a digit string if all characters in the string are digits and there is at least one character in the string.
- isidentifier()¶
Return True if the string is a valid Python identifier, False otherwise.
Call keyword.iskeyword(s) to test whether string s is a reserved identifier, such as “def” or “class”.
- islower()¶
Return True if the string is a lowercase string, False otherwise.
A string is lowercase if all cased characters in the string are lowercase and there is at least one cased character in the string.
- isnumeric()¶
Return True if the string is a numeric string, False otherwise.
A string is numeric if all characters in the string are numeric and there is at least one character in the string.
- isprintable()¶
Return True if all characters in the string are printable, False otherwise.
A character is printable if repr() may use it in its output.
- isspace()¶
Return True if the string is a whitespace string, False otherwise.
A string is whitespace if all characters in the string are whitespace and there is at least one character in the string.
- istitle()¶
Return True if the string is a title-cased string, False otherwise.
In a title-cased string, upper- and title-case characters may only follow uncased characters and lowercase characters only cased ones.
- isupper()¶
Return True if the string is an uppercase string, False otherwise.
A string is uppercase if all cased characters in the string are uppercase and there is at least one cased character in the string.
- join(iterable, /)¶
Concatenate any number of strings.
The string whose method is called is inserted in between each given string. The result is returned as a new string.
Example: ‘.’.join([‘ab’, ‘pq’, ‘rs’]) -> ‘ab.pq.rs’
- ljust(width, fillchar=' ', /)¶
Return a left-justified string of length width.
Padding is done using the specified fill character (default is a space).
- lower()¶
Return a copy of the string converted to lowercase.
- lstrip(chars=None, /)¶
Return a copy of the string with leading whitespace removed.
If chars is given and not None, remove characters in chars instead.
- static maketrans()¶
Return a translation table usable for str.translate().
If there is only one argument, it must be a dictionary mapping Unicode ordinals (integers) or characters to Unicode ordinals, strings or None. Character keys will be then converted to ordinals. If there are two arguments, they must be strings of equal length, and in the resulting dictionary, each character in x will be mapped to the character at the same position in y. If there is a third argument, it must be a string, whose characters will be mapped to None in the result.
- partition(sep, /)¶
Partition the string into three parts using the given separator.
This will search for the separator in the string. If the separator is found, returns a 3-tuple containing the part before the separator, the separator itself, and the part after it.
If the separator is not found, returns a 3-tuple containing the original string and two empty strings.
- removeprefix(prefix, /)¶
Return a str with the given prefix string removed if present.
If the string starts with the prefix string, return string[len(prefix):]. Otherwise, return a copy of the original string.
- removesuffix(suffix, /)¶
Return a str with the given suffix string removed if present.
If the string ends with the suffix string and that suffix is not empty, return string[:-len(suffix)]. Otherwise, return a copy of the original string.
- replace(old, new, /, count=-1)¶
Return a copy with all occurrences of substring old replaced by new.
- count
Maximum number of occurrences to replace. -1 (the default value) means replace all occurrences.
If the optional argument count is given, only the first count occurrences are replaced.
- rfind()¶
Return the highest index in S where substring sub is found, such that sub is contained within S[start:end].
Optional arguments start and end are interpreted as in slice notation. Return -1 on failure.
- rindex()¶
Return the highest index in S where substring sub is found, such that sub is contained within S[start:end].
Optional arguments start and end are interpreted as in slice notation. Raises ValueError when the substring is not found.
- rjust(width, fillchar=' ', /)¶
Return a right-justified string of length width.
Padding is done using the specified fill character (default is a space).
- rpartition(sep, /)¶
Partition the string into three parts using the given separator.
This will search for the separator in the string, starting at the end. If the separator is found, returns a 3-tuple containing the part before the separator, the separator itself, and the part after it.
If the separator is not found, returns a 3-tuple containing two empty strings and the original string.
- rsplit(sep=None, maxsplit=-1)¶
Return a list of the substrings in the string, using sep as the separator string.
- sep
The separator used to split the string.
When set to None (the default value), will split on any whitespace character (including n r t f and spaces) and will discard empty strings from the result.
- maxsplit
Maximum number of splits. -1 (the default value) means no limit.
Splitting starts at the end of the string and works to the front.
- rstrip(chars=None, /)¶
Return a copy of the string with trailing whitespace removed.
If chars is given and not None, remove characters in chars instead.
- split(sep=None, maxsplit=-1)¶
Return a list of the substrings in the string, using sep as the separator string.
- sep
The separator used to split the string.
When set to None (the default value), will split on any whitespace character (including n r t f and spaces) and will discard empty strings from the result.
- maxsplit
Maximum number of splits. -1 (the default value) means no limit.
Splitting starts at the front of the string and works to the end.
Note, str.split() is mainly useful for data that has been intentionally delimited. With natural text that includes punctuation, consider using the regular expression module.
- splitlines(keepends=False)¶
Return a list of the lines in the string, breaking at line boundaries.
Line breaks are not included in the resulting list unless keepends is given and true.
- startswith()¶
Return True if the string starts with the specified prefix, False otherwise.
- prefix
A string or a tuple of strings to try.
- start
Optional start position. Default: start of the string.
- end
Optional stop position. Default: end of the string.
- strip(chars=None, /)¶
Return a copy of the string with leading and trailing whitespace removed.
If chars is given and not None, remove characters in chars instead.
- swapcase()¶
Convert uppercase characters to lowercase and lowercase characters to uppercase.
- title()¶
Return a version of the string where each word is titlecased.
More specifically, words start with uppercased characters and all remaining cased characters have lower case.
- translate(table, /)¶
Replace each character in the string using the given translation table.
- table
Translation table, which must be a mapping of Unicode ordinals to Unicode ordinals, strings, or None.
The table must implement lookup/indexing via __getitem__, for instance a dictionary or list. If this operation raises LookupError, the character is left untouched. Characters mapped to None are deleted.
- upper()¶
Return a copy of the string converted to uppercase.
- zfill(width, /)¶
Pad a numeric string with zeros on the left, to fill a field of the given width.
The string is never truncated.
- exception pyteomics.auxiliary.structures.PyteomicsError(msg, *values)[source]¶
Bases:
ExceptionException raised for errors in Pyteomics library.
- add_note(note, /)¶
Add a note to the exception
- with_traceback(tb, /)¶
Set self.__traceback__ to tb and return self.
- pyteomics.auxiliary.structures.clear_unit_cv_table()[source]¶
Clear the module-level unit name and controlled vocabulary accession table.
- class pyteomics.auxiliary.file_helpers.ChainBase(*sources, **kwargs)[source]¶
Bases:
TaskMappingMixinChain
sequence_maker()for several sources into a single iterable. Positional arguments should be sources like file names or file objects. Keyword arguments are passed to thesequence_maker()function.- Parameters:
sources (
Iterable) – Sources for creating new sequences from, such as paths or file-like objectskwargs (
Mapping) – Additional arguments used to instantiate each sequence
- __init__(*sources, **kwargs)[source]¶
Instantiate a
MultiProcessingTaskMappingMixinobject, set default parameters for IPC.- Parameters:
queue_timeout (float, keyword only, optional) – The number of seconds to block, waiting for a result before checking to see if all workers are done.
queue_size (int, keyword only, optional) – The length of IPC queue used.
workers (int, keyword only, optional) – Number of worker processes or threads to spawn when
map()is called. This can also be specified in themap()call.
- map(target=None, workers=None, args=None, kwargs=None, method='mp', **_kwargs)¶
Execute the
targetfunction over entries of this object in parallel. The type of parallelism is determined by themethodparameter.Results will be returned out of order.
- Parameters:
target (
Callable, optional) – The function to execute over each entry. It will be given a single object yielded by the wrapped iterator as well as all of the values inargsandkwargs.workers (int, optional) – The number of worker threads or processes to use. The default depends on the
methodparameter.args (
Sequence, optional) – Additional positional arguments to be passed to the target function.kwargs (
Mapping, optional) – Additional keyword arguments to be passed to the target function.method (str, optional) –
The type of parallelism to use. Can be one of the following:
**_kwargs – Additional keyword arguments to be passed to the target function.
- Yields:
object – The work item returned by the target function.
- pmap(*args, **kwargs)[source]¶
Execute the
targetfunction over entries of this object across up toworkersprocesses.Results will be returned out of order.
- Parameters:
target (
Callable, optional) – The function to execute over each entry. It will be given a single object yielded by the wrapped iterator as well as all of the values inargsandkwargs.workers (int or None, optional) – The number of worker processes to use. If not a positive integer, defaults to the number of available CPUs. This parameter can also be set at reader creation.
args (
Sequence, optional) – Additional positional arguments to be passed to the target function.kwargs (
Mapping, optional) – Additional keyword arguments to be passed to the target function.**_kwargs – Additional keyword arguments to be passed to the target function.
- Yields:
object – The work item returned by the target function.
- tmap(*args, **kwargs)[source]¶
Execute the
targetfunction over entries of this object across up toworkersthreads.Results will be returned out of order.
- Parameters:
target (
Callable, optional) –The function to execute over each entry. It will be given a single object yielded by the wrapped iterator as well as all of the values in
argsandkwargs.Warning
target must be thread-safe. The target function cannot interact with the underlying file object directly.
workers (int or None, optional) – The number of worker threads to use. If not a positive integer, defaults to the number of available CPUs.
args (
Sequence, optional) – Additional positional arguments to be passed to the target function.kwargs (
Mapping, optional) – Additional keyword arguments to be passed to the target function.chunk_size (int, optional) – The number of work items to hand out to each worker thread at a time. If not specified, defaults to
chunk_sizeattribute of this object.**_kwargs – Additional keyword arguments to be passed to the target function.
- Yields:
object – The work item returned by the target function.
- class pyteomics.auxiliary.file_helpers.FileReader(source, **kwargs)[source]¶
Bases:
IteratorContextManagerAbstract class implementing context manager protocol for file readers.
- class pyteomics.auxiliary.file_helpers.FileReadingProcess(reader_spec, target_spec, qin, qout, args_spec, kwargs_spec)[source]¶
Bases:
ForkServerProcessProcess that does a share of distributed work on entries read from file. Reconstructs a reader object, parses an entries from given indexes, optionally does additional processing, sends results back.
The reader class must support the
__getitem__()dict-like lookup.- close()¶
Close the Process object.
This method releases resources held by the Process object. It is an error to call this method if the child process is still running.
- property daemon¶
Return whether process is a daemon
- property exitcode¶
Return exit code of process or None if it has yet to stop
- property ident¶
Return identifier (PID) of process or None if it has yet to start
- interrupt()¶
Terminate process; sends SIGINT signal
- is_alive()¶
Return whether process is alive
- join(timeout=None)¶
Wait until child process terminates
- kill()¶
Terminate process; sends SIGKILL signal or uses TerminateProcess()
- property pid¶
Return identifier (PID) of process or None if it has yet to start
- property sentinel¶
Return a file descriptor (Unix) or handle (Windows) suitable for waiting for process termination.
- start()¶
Start child process
- terminate()¶
Terminate process; sends SIGTERM signal or uses TerminateProcess()
- class pyteomics.auxiliary.file_helpers.IndexSavingMixin(*args, **kwargs)[source]¶
Bases:
NoOpBaseReaderCommon interface for
IndexSavingXMLandIndexSavingTextReader.- __init__(*args, **kwargs)¶
- build_byte_index()[source]¶
Build the byte offset index by either reading these offsets from the file at
_byte_offset_filename, or falling back to the method used byIndexedXMLorIndexedTextReaderif this operation fails due to an IOError
- class pyteomics.auxiliary.file_helpers.IndexSavingTextReader(source, **kwargs)[source]¶
Bases:
IndexSavingMixin,IndexedTextReader- __init__(source, **kwargs)¶
- build_byte_index()¶
Build the byte offset index by either reading these offsets from the file at
_byte_offset_filename, or falling back to the method used byIndexedXMLorIndexedTextReaderif this operation fails due to an IOError
- classmethod prebuild_byte_offset_file(path)¶
Construct a new XML reader, build its byte offset index and write it to file
- Parameters:
path (str) – The path to the file to parse
- reset()¶
Resets the iterator to its initial state.
- write_byte_offsets()¶
Write the byte offsets in
_offset_indexto the file at_byte_offset_filename
- class pyteomics.auxiliary.file_helpers.IndexedReaderMixin(*args, **kwargs)[source]¶
Bases:
NoOpBaseReaderCommon interface for
IndexedTextReaderandIndexedXML.- __init__(*args, **kwargs)¶
- class pyteomics.auxiliary.file_helpers.IndexedTextReader(source, **kwargs)[source]¶
Bases:
IndexedReaderMixin,FileReaderAbstract class for text file readers that keep an index of records for random access. This requires reading the file in binary mode.
- reset()¶
Resets the iterator to its initial state.
- class pyteomics.auxiliary.file_helpers.OffsetIndex(*args, **kwargs)[source]¶
Bases:
OrderedDict,WritableIndexAn augmented OrderedDict that formally wraps getting items by index
- clear() None. Remove all items from od.¶
- copy() a shallow copy of od¶
- from_index(index, include_value=False)[source]¶
Get an entry by its integer index in the ordered sequence of this mapping.
- from_slice(spec, include_value=False)[source]¶
Get a slice along index in the ordered sequence of this mapping.
- Parameters:
- Returns:
If
include_valueisTrue, a tuple of (key, value) atindexelse just the key atindexfor eachindexinspec- Return type:
- classmethod fromkeys(iterable, value=None)¶
Create a new ordered dictionary with keys from iterable and values set to value.
- get(key, default=None, /)¶
Return the value for key if key is in the dictionary, else default.
- property index_sequence¶
Keeps a cached copy of the
items()sequence stored as atupleto avoid repeatedly copying the sequence over many method calls.- Return type:
- items()¶
Return a set-like object providing a view on the dict’s items.
- keys()¶
Return a set-like object providing a view on the dict’s keys.
- move_to_end(key, last=True)¶
Move an existing element to the end (or beginning if last is false).
Raise KeyError if the element does not exist.
- pop(key[, default]) v, remove specified key and return the corresponding value.[source]¶
If the key is not found, return the default if given; otherwise, raise a KeyError.
- popitem(last=True)¶
Remove and return a (key, value) pair from the dictionary.
Pairs are returned in LIFO order if last is true or FIFO order if false.
- setdefault(key, default=None)¶
Insert key with a value of default if key is not in the dictionary.
Return the value for key if key is in the dictionary, else default.
- update([E, ]**F) None. Update D from mapping/iterable E and F.¶
If E is present and has a .keys() method, then does: for k in E.keys(): D[k] = E[k] If E is present and lacks a .keys() method, then does: for k, v in E: D[k] = v In either case, this is followed by: for k in F: D[k] = F[k]
- values()¶
Return an object providing a view on the dict’s values.
- class pyteomics.auxiliary.file_helpers.TableJoiner(*sources, **kwargs)[source]¶
Bases:
ChainBase- __init__(*sources, **kwargs)¶
Instantiate a
MultiProcessingTaskMappingMixinobject, set default parameters for IPC.- Parameters:
queue_timeout (float, keyword only, optional) – The number of seconds to block, waiting for a result before checking to see if all workers are done.
queue_size (int, keyword only, optional) – The length of IPC queue used.
workers (int, keyword only, optional) – Number of worker processes or threads to spawn when
map()is called. This can also be specified in themap()call.
- map(target=None, workers=None, args=None, kwargs=None, method='mp', **_kwargs)¶
Execute the
targetfunction over entries of this object in parallel. The type of parallelism is determined by themethodparameter.Results will be returned out of order.
- Parameters:
target (
Callable, optional) – The function to execute over each entry. It will be given a single object yielded by the wrapped iterator as well as all of the values inargsandkwargs.workers (int, optional) – The number of worker threads or processes to use. The default depends on the
methodparameter.args (
Sequence, optional) – Additional positional arguments to be passed to the target function.kwargs (
Mapping, optional) – Additional keyword arguments to be passed to the target function.method (str, optional) –
The type of parallelism to use. Can be one of the following:
**_kwargs – Additional keyword arguments to be passed to the target function.
- Yields:
object – The work item returned by the target function.
- pmap(*args, **kwargs)¶
Execute the
targetfunction over entries of this object across up toworkersprocesses.Results will be returned out of order.
- Parameters:
target (
Callable, optional) – The function to execute over each entry. It will be given a single object yielded by the wrapped iterator as well as all of the values inargsandkwargs.workers (int or None, optional) – The number of worker processes to use. If not a positive integer, defaults to the number of available CPUs. This parameter can also be set at reader creation.
args (
Sequence, optional) – Additional positional arguments to be passed to the target function.kwargs (
Mapping, optional) – Additional keyword arguments to be passed to the target function.**_kwargs – Additional keyword arguments to be passed to the target function.
- Yields:
object – The work item returned by the target function.
- tmap(*args, **kwargs)¶
Execute the
targetfunction over entries of this object across up toworkersthreads.Results will be returned out of order.
- Parameters:
target (
Callable, optional) –The function to execute over each entry. It will be given a single object yielded by the wrapped iterator as well as all of the values in
argsandkwargs.Warning
target must be thread-safe. The target function cannot interact with the underlying file object directly.
workers (int or None, optional) – The number of worker threads to use. If not a positive integer, defaults to the number of available CPUs.
args (
Sequence, optional) – Additional positional arguments to be passed to the target function.kwargs (
Mapping, optional) – Additional keyword arguments to be passed to the target function.chunk_size (int, optional) – The number of work items to hand out to each worker thread at a time. If not specified, defaults to
chunk_sizeattribute of this object.**_kwargs – Additional keyword arguments to be passed to the target function.
- Yields:
object – The work item returned by the target function.
- class pyteomics.auxiliary.file_helpers.TaskMappingMixin(*args, **kwargs)[source]¶
Bases:
MultiProcessingTaskMappingMixin,ThreadingTaskMappingMixin- __init__(*args, **kwargs)¶
Instantiate a
MultiProcessingTaskMappingMixinobject, set default parameters for IPC.- Parameters:
queue_timeout (float, keyword only, optional) – The number of seconds to block, waiting for a result before checking to see if all workers are done.
queue_size (int, keyword only, optional) – The length of IPC queue used.
workers (int, keyword only, optional) – Number of worker processes or threads to spawn when
map()is called. This can also be specified in themap()call.
- map(target=None, workers=None, args=None, kwargs=None, method='mp', **_kwargs)[source]¶
Execute the
targetfunction over entries of this object in parallel. The type of parallelism is determined by themethodparameter.Results will be returned out of order.
- Parameters:
target (
Callable, optional) – The function to execute over each entry. It will be given a single object yielded by the wrapped iterator as well as all of the values inargsandkwargs.workers (int, optional) – The number of worker threads or processes to use. The default depends on the
methodparameter.args (
Sequence, optional) – Additional positional arguments to be passed to the target function.kwargs (
Mapping, optional) – Additional keyword arguments to be passed to the target function.method (str, optional) –
The type of parallelism to use. Can be one of the following:
**_kwargs – Additional keyword arguments to be passed to the target function.
- Yields:
object – The work item returned by the target function.
- pmap(target=None, workers=None, args=None, kwargs=None, **_kwargs)¶
Execute the
targetfunction over entries of this object across up toworkersprocesses.Results will be returned out of order.
- Parameters:
target (
Callable, optional) – The function to execute over each entry. It will be given a single object yielded by the wrapped iterator as well as all of the values inargsandkwargs.workers (int or None, optional) – The number of worker processes to use. If not a positive integer, defaults to the number of available CPUs. This parameter can also be set at reader creation.
args (
Sequence, optional) – Additional positional arguments to be passed to the target function.kwargs (
Mapping, optional) – Additional keyword arguments to be passed to the target function.**_kwargs – Additional keyword arguments to be passed to the target function.
- Yields:
object – The work item returned by the target function.
- tmap(target=None, workers=None, args=None, kwargs=None, chunk_size=None, **_kwargs)¶
Execute the
targetfunction over entries of this object across up toworkersthreads.Results will be returned out of order.
- Parameters:
target (
Callable, optional) –The function to execute over each entry. It will be given a single object yielded by the wrapped iterator as well as all of the values in
argsandkwargs.Warning
target must be thread-safe. The target function cannot interact with the underlying file object directly.
workers (int or None, optional) – The number of worker threads to use. If not a positive integer, defaults to the number of available CPUs.
args (
Sequence, optional) – Additional positional arguments to be passed to the target function.kwargs (
Mapping, optional) – Additional keyword arguments to be passed to the target function.chunk_size (int, optional) – The number of work items to hand out to each worker thread at a time. If not specified, defaults to
chunk_sizeattribute of this object.**_kwargs – Additional keyword arguments to be passed to the target function.
- Yields:
object – The work item returned by the target function.
- class pyteomics.auxiliary.file_helpers.ThreadingTaskMappingMixin(*args, **kwargs)[source]¶
Bases:
BaseTaskMappingMixinMixin implementing thread-based parallelism for
map()calls. The use of threaded parallelism is warranted in free-threaded environments, such as the experimental free-threaded CPython interpreter.- __init__(*args, **kwargs)¶
- map(target=None, workers=None, args=None, kwargs=None, chunk_size=None, **_kwargs)[source]¶
Execute the
targetfunction over entries of this object across up toworkersthreads.Results will be returned out of order.
- Parameters:
target (
Callable, optional) –The function to execute over each entry. It will be given a single object yielded by the wrapped iterator as well as all of the values in
argsandkwargs.Warning
target must be thread-safe. The target function cannot interact with the underlying file object directly.
workers (int or None, optional) – The number of worker threads to use. If not a positive integer, defaults to the number of available CPUs.
args (
Sequence, optional) – Additional positional arguments to be passed to the target function.kwargs (
Mapping, optional) – Additional keyword arguments to be passed to the target function.chunk_size (int, optional) – The number of work items to hand out to each worker thread at a time. If not specified, defaults to
chunk_sizeattribute of this object.**_kwargs – Additional keyword arguments to be passed to the target function.
- Yields:
object – The work item returned by the target function.
- class pyteomics.auxiliary.file_helpers.TimeOrderedIndexedReaderMixin(*args, **kwargs)[source]¶
Bases:
IndexedReaderMixin