Database Functions

The classes documented below provide a way for users to use functions providedby the underlying database as annotations, aggregations, or filters in Django.Functions are also expressions, so they can be used andcombined with other expressions like aggregate functions.

We'll be using the following model in examples of each function:

  1. class Author(models.Model):
  2. name = models.CharField(max_length=50)
  3. age = models.PositiveIntegerField(null=True, blank=True)
  4. alias = models.CharField(max_length=50, null=True, blank=True)
  5. goes_by = models.CharField(max_length=50, null=True, blank=True)

We don't usually recommend allowing null=True for CharField since thisallows the field to have two "empty values", but it's important for theCoalesce example below.

Comparison and conversion functions

Cast

  • class Cast(expression, output_field)[source]
  • Forces the result type of expression to be the one from output_field.

Usage example:

  1. >>> from django.db.models import FloatField
  2. >>> from django.db.models.functions import Cast
  3. >>> Value.objects.create(integer=4)
  4. >>> value = Value.objects.annotate(as_float=Cast('integer', FloatField())).get()
  5. >>> print(value.as_float)
  6. 4.0

Coalesce

  • class Coalesce(*expressions, **extra)[source]
  • Accepts a list of at least two field names or expressions and returns thefirst non-null value (note that an empty string is not considered a nullvalue). Each argument must be of a similar type, so mixing text and numberswill result in a database error.

Usage examples:

  1. >>> # Get a screen name from least to most public
  2. >>> from django.db.models import Sum, Value as V
  3. >>> from django.db.models.functions import Coalesce
  4. >>> Author.objects.create(name='Margaret Smith', goes_by='Maggie')
  5. >>> author = Author.objects.annotate(
  6. ... screen_name=Coalesce('alias', 'goes_by', 'name')).get()
  7. >>> print(author.screen_name)
  8. Maggie
  9.  
  10. >>> # Prevent an aggregate Sum() from returning None
  11. >>> aggregated = Author.objects.aggregate(
  12. ... combined_age=Coalesce(Sum('age'), V(0)),
  13. ... combined_age_default=Sum('age'))
  14. >>> print(aggregated['combined_age'])
  15. 0
  16. >>> print(aggregated['combined_age_default'])
  17. None

Warning

A Python value passed to Coalesce on MySQL may be converted to anincorrect type unless explicitly cast to the correct database type:

  1. >>> from django.db.models import DateTimeField
  2. >>> from django.db.models.functions import Cast, Coalesce
  3. >>> from django.utils import timezone
  4. >>> now = timezone.now()
  5. >>> Coalesce('updated', Cast(now, DateTimeField()))

Greatest

  • class Greatest(*expressions, **extra)[source]
  • Accepts a list of at least two field names or expressions and returns thegreatest value. Each argument must be of a similar type, so mixing text andnumbers will result in a database error.

Usage example:

  1. class Blog(models.Model):
  2. body = models.TextField()
  3. modified = models.DateTimeField(auto_now=True)
  4.  
  5. class Comment(models.Model):
  6. body = models.TextField()
  7. modified = models.DateTimeField(auto_now=True)
  8. blog = models.ForeignKey(Blog, on_delete=models.CASCADE)
  9.  
  10. >>> from django.db.models.functions import Greatest
  11. >>> blog = Blog.objects.create(body='Greatest is the best.')
  12. >>> comment = Comment.objects.create(body='No, Least is better.', blog=blog)
  13. >>> comments = Comment.objects.annotate(last_updated=Greatest('modified', 'blog__modified'))
  14. >>> annotated_comment = comments.get()

annotated_comment.last_updated will be the most recent of blog.modifiedand comment.modified.

Warning

The behavior of Greatest when one or more expression may be nullvaries between databases:

  • PostgreSQL: Greatest will return the largest non-null expression,or null if all expressions are null.
  • SQLite, Oracle, and MySQL: If any expression is null, Greatestwill return null.The PostgreSQL behavior can be emulated using Coalesce if you knowa sensible minimum value to provide as a default.

Least

  • class Least(*expressions, **extra)[source]
  • Accepts a list of at least two field names or expressions and returns theleast value. Each argument must be of a similar type, so mixing text and numberswill result in a database error.

Warning

The behavior of Least when one or more expression may be nullvaries between databases:

  • PostgreSQL: Least will return the smallest non-null expression,or null if all expressions are null.
  • SQLite, Oracle, and MySQL: If any expression is null, Leastwill return null.The PostgreSQL behavior can be emulated using Coalesce if you knowa sensible maximum value to provide as a default.

Date functions

We'll be using the following model in examples of each function:

  1. class Experiment(models.Model):
  2. start_datetime = models.DateTimeField()
  3. start_date = models.DateField(null=True, blank=True)
  4. start_time = models.TimeField(null=True, blank=True)
  5. end_datetime = models.DateTimeField(null=True, blank=True)
  6. end_date = models.DateField(null=True, blank=True)
  7. end_time = models.TimeField(null=True, blank=True)

Extract

  • class Extract(expression, lookup_name=None, tzinfo=None, **extra)[source]
  • Extracts a component of a date as a number.

Takes an expression representing a DateField, DateTimeField,TimeField, or DurationField and a lookup_name, and returns the partof the date referenced by lookup_name as an IntegerField.Django usually uses the databases' extract function, so you may use anylookup_name that your database supports. A tzinfo subclass, usuallyprovided by pytz, can be passed to extract a value in a specific timezone.

Changed in Django 2.0:Support for DurationField was added.

Given the datetime 2015-06-15 23:30:01.000321+00:00, the built-inlookup_names return:

  • "year": 2015
  • "quarter": 2
  • "month": 6
  • "day": 15
  • "week": 25
  • "week_day": 2
  • "hour": 23
  • "minute": 30
  • "second": 1If a different timezone like Australia/Melbourne is active in Django, thenthe datetime is converted to the timezone before the value is extracted. Thetimezone offset for Melbourne in the example date above is +10:00. The valuesreturned when this timezone is active will be the same as above except for:

  • "day": 16

  • "week_day": 3
  • "hour": 9

week_day values

The week_day lookup_type is calculated differently from mostdatabases and from Python's standard functions. This function will return1 for Sunday, 2 for Monday, through 7 for Saturday.

The equivalent calculation in Python is:

  1. >>> from datetime import datetime
  2. >>> dt = datetime(2015, 6, 15)
  3. >>> (dt.isoweekday() % 7) + 1
  4. 2

week values

The week lookup_type is calculated based on ISO-8601, i.e.,a week starts on a Monday. The first week of a year is the one thatcontains the year's first Thursday, i.e. the first week has the majority(four or more) of its days in the year. The value returned is in the range1 to 52 or 53.

Each lookup_name above has a corresponding Extract subclass (listedbelow) that should typically be used instead of the more verbose equivalent,e.g. use ExtractYear(…) rather than Extract(…, lookup_name='year').

Usage example:

  1. >>> from datetime import datetime
  2. >>> from django.db.models.functions import Extract
  3. >>> start = datetime(2015, 6, 15)
  4. >>> end = datetime(2015, 7, 2)
  5. >>> Experiment.objects.create(
  6. ... start_datetime=start, start_date=start.date(),
  7. ... end_datetime=end, end_date=end.date())
  8. >>> # Add the experiment start year as a field in the QuerySet.
  9. >>> experiment = Experiment.objects.annotate(
  10. ... start_year=Extract('start_datetime', 'year')).get()
  11. >>> experiment.start_year
  12. 2015
  13. >>> # How many experiments completed in the same year in which they started?
  14. >>> Experiment.objects.filter(
  15. ... start_datetime__year=Extract('end_datetime', 'year')).count()
  16. 1

DateField extracts

  • class ExtractYear(expression, tzinfo=None, **extra)[source]
    • lookup_name = 'year'
  • class ExtractMonth(expression, tzinfo=None, **extra)[source]
    • lookup_name = 'month'
  • class ExtractDay(expression, tzinfo=None, **extra)[source]
    • lookup_name = 'day'
  • class ExtractWeekDay(expression, tzinfo=None, **extra)[source]
    • lookup_name = 'week_day'
  • class ExtractWeek(expression, tzinfo=None, **extra)[source]
  • New in Django 1.11.

    • lookup_name = 'week'
  • class ExtractQuarter(expression, tzinfo=None, **extra)[source]
  • New in Django 2.0.

    • lookup_name = 'quarter'
    • These are logically equivalent to Extract('datefield', lookupname). Eachclass is also a Transform registered on DateField and DateTimeFieldas (lookup_name), e.g. __year.

Since DateFields don't have a time component, only Extract subclassesthat deal with date-parts can be used with DateField:

  1. >>> from datetime import datetime
  2. >>> from django.utils import timezone
  3. >>> from django.db.models.functions import (
  4. ... ExtractDay, ExtractMonth, ExtractQuarter, ExtractWeek,
  5. ... ExtractWeekDay, ExtractYear,
  6. ... )
  7. >>> start_2015 = datetime(2015, 6, 15, 23, 30, 1, tzinfo=timezone.utc)
  8. >>> end_2015 = datetime(2015, 6, 16, 13, 11, 27, tzinfo=timezone.utc)
  9. >>> Experiment.objects.create(
  10. ... start_datetime=start_2015, start_date=start_2015.date(),
  11. ... end_datetime=end_2015, end_date=end_2015.date())
  12. >>> Experiment.objects.annotate(
  13. ... year=ExtractYear('start_date'),
  14. ... quarter=ExtractQuarter('start_date'),
  15. ... month=ExtractMonth('start_date'),
  16. ... week=ExtractWeek('start_date'),
  17. ... day=ExtractDay('start_date'),
  18. ... weekday=ExtractWeekDay('start_date'),
  19. ... ).values('year', 'quarter', 'month', 'week', 'day', 'weekday').get(
  20. ... end_date__year=ExtractYear('start_date'),
  21. ... )
  22. {'year': 2015, 'quarter': 2, 'month': 6, 'week': 25, 'day': 15, 'weekday': 2}

DateTimeField extracts

In addition to the following, all extracts for DateField listed above mayalso be used on DateTimeFields .

  • class ExtractHour(expression, tzinfo=None, **extra)[source]
    • lookup_name = 'hour'
  • class ExtractMinute(expression, tzinfo=None, **extra)[source]
    • lookup_name = 'minute'
  • class ExtractSecond(expression, tzinfo=None, **extra)[source]
    • lookup_name = 'second'
    • These are logically equivalent to Extract('datetimefield', lookupname).Each class is also a Transform registered on DateTimeField as(lookup_name), e.g. __minute.

DateTimeField examples:

  1. >>> from datetime import datetime
  2. >>> from django.utils import timezone
  3. >>> from django.db.models.functions import (
  4. ... ExtractDay, ExtractHour, ExtractMinute, ExtractMonth,
  5. ... ExtractQuarter, ExtractSecond, ExtractWeek, ExtractWeekDay,
  6. ... ExtractYear,
  7. ... )
  8. >>> start_2015 = datetime(2015, 6, 15, 23, 30, 1, tzinfo=timezone.utc)
  9. >>> end_2015 = datetime(2015, 6, 16, 13, 11, 27, tzinfo=timezone.utc)
  10. >>> Experiment.objects.create(
  11. ... start_datetime=start_2015, start_date=start_2015.date(),
  12. ... end_datetime=end_2015, end_date=end_2015.date())
  13. >>> Experiment.objects.annotate(
  14. ... year=ExtractYear('start_datetime'),
  15. ... quarter=ExtractQuarter('start_datetime'),
  16. ... month=ExtractMonth('start_datetime'),
  17. ... week=ExtractWeek('start_datetime'),
  18. ... day=ExtractDay('start_datetime'),
  19. ... weekday=ExtractWeekDay('start_datetime'),
  20. ... hour=ExtractHour('start_datetime'),
  21. ... minute=ExtractMinute('start_datetime'),
  22. ... second=ExtractSecond('start_datetime'),
  23. ... ).values(
  24. ... 'year', 'month', 'week', 'day', 'weekday', 'hour', 'minute', 'second',
  25. ... ).get(end_datetime__year=ExtractYear('start_datetime'))
  26. {'year': 2015, 'quarter': 2, 'month': 6, 'week': 25, 'day': 15, 'weekday': 2,
  27. 'hour': 23, 'minute': 30, 'second': 1}

When USE_TZ is True then datetimes are stored in the databasein UTC. If a different timezone is active in Django, the datetime is convertedto that timezone before the value is extracted. The example below converts tothe Melbourne timezone (UTC +10:00), which changes the day, weekday, and hourvalues that are returned:

  1. >>> import pytz
  2. >>> melb = pytz.timezone('Australia/Melbourne') # UTC+10:00
  3. >>> with timezone.override(melb):
  4. ... Experiment.objects.annotate(
  5. ... day=ExtractDay('start_datetime'),
  6. ... weekday=ExtractWeekDay('start_datetime'),
  7. ... hour=ExtractHour('start_datetime'),
  8. ... ).values('day', 'weekday', 'hour').get(
  9. ... end_datetime__year=ExtractYear('start_datetime'),
  10. ... )
  11. {'day': 16, 'weekday': 3, 'hour': 9}

Explicitly passing the timezone to the Extract function behaves in the sameway, and takes priority over an active timezone:

  1. >>> import pytz
  2. >>> melb = pytz.timezone('Australia/Melbourne')
  3. >>> Experiment.objects.annotate(
  4. ... day=ExtractDay('start_datetime', tzinfo=melb),
  5. ... weekday=ExtractWeekDay('start_datetime', tzinfo=melb),
  6. ... hour=ExtractHour('start_datetime', tzinfo=melb),
  7. ... ).values('day', 'weekday', 'hour').get(
  8. ... end_datetime__year=ExtractYear('start_datetime'),
  9. ... )
  10. {'day': 16, 'weekday': 3, 'hour': 9}

Now

  • class Now[source]
  • Returns the database server's current date and time when the query is executed,typically using the SQL CURRENT_TIMESTAMP.

Usage example:

  1. >>> from django.db.models.functions import Now
  2. >>> Article.objects.filter(published__lte=Now())
  3. <QuerySet [<Article: How to Django>]>

PostgreSQL considerations

On PostgreSQL, the SQL CURRENT_TIMESTAMP returns the time that thecurrent transaction started. Therefore for cross-database compatibility,Now() uses STATEMENT_TIMESTAMP instead. If you need the transactiontimestamp, use django.contrib.postgres.functions.TransactionNow.

Trunc

  • class Trunc(expression, kind, output_field=None, tzinfo=None, **extra)[source]
  • Truncates a date up to a significant component.

When you only care if something happened in a particular year, hour, or day,but not the exact second, then Trunc (and its subclasses) can be useful tofilter or aggregate your data. For example, you can use Trunc to calculatethe number of sales per day.

Trunc takes a single expression, representing a DateField,TimeField, or DateTimeField, a kind representing a date or timepart, and an output_field that's either DateTimeField(),TimeField(), or DateField(). It returns a datetime, date, or timedepending on output_field, with fields up to kind set to their minimumvalue. If output_field is omitted, it will default to the output_fieldof expression. A tzinfo subclass, usually provided by pytz, can bepassed to truncate a value in a specific timezone.

Given the datetime 2015-06-15 14:30:50.000321+00:00, the built-in kindsreturn:

  • "year": 2015-01-01 00:00:00+00:00
  • "quarter": 2015-04-01 00:00:00+00:00
  • "month": 2015-06-01 00:00:00+00:00
  • "day": 2015-06-15 00:00:00+00:00
  • "hour": 2015-06-15 14:00:00+00:00
  • "minute": 2015-06-15 14:30:00+00:00
  • "second": 2015-06-15 14:30:50+00:00If a different timezone like Australia/Melbourne is active in Django, thenthe datetime is converted to the new timezone before the value is truncated.The timezone offset for Melbourne in the example date above is +10:00. Thevalues returned when this timezone is active will be:

  • "year": 2015-01-01 00:00:00+11:00

  • "quarter": 2015-04-01 00:00:00+10:00
  • "month": 2015-06-01 00:00:00+10:00
  • "day": 2015-06-16 00:00:00+10:00
  • "hour": 2015-06-16 00:00:00+10:00
  • "minute": 2015-06-16 00:30:00+10:00
  • "second": 2015-06-16 00:30:50+10:00The year has an offset of +11:00 because the result transitioned into daylightsaving time.

Each kind above has a corresponding Trunc subclass (listed below) thatshould typically be used instead of the more verbose equivalent,e.g. use TruncYear(…) rather than Trunc(…, kind='year').

The subclasses are all defined as transforms, but they aren't registered withany fields, because the obvious lookup names are already reserved by theExtract subclasses.

Usage example:

  1. >>> from datetime import datetime
  2. >>> from django.db.models import Count, DateTimeField
  3. >>> from django.db.models.functions import Trunc
  4. >>> Experiment.objects.create(start_datetime=datetime(2015, 6, 15, 14, 30, 50, 321))
  5. >>> Experiment.objects.create(start_datetime=datetime(2015, 6, 15, 14, 40, 2, 123))
  6. >>> Experiment.objects.create(start_datetime=datetime(2015, 12, 25, 10, 5, 27, 999))
  7. >>> experiments_per_day = Experiment.objects.annotate(
  8. ... start_day=Trunc('start_datetime', 'day', output_field=DateTimeField())
  9. ... ).values('start_day').annotate(experiments=Count('id'))
  10. >>> for exp in experiments_per_day:
  11. ... print(exp['start_day'], exp['experiments'])
  12. ...
  13. 2015-06-15 00:00:00 2
  14. 2015-12-25 00:00:00 1
  15. >>> experiments = Experiment.objects.annotate(
  16. ... start_day=Trunc('start_datetime', 'day', output_field=DateTimeField())
  17. ... ).filter(start_day=datetime(2015, 6, 15))
  18. >>> for exp in experiments:
  19. ... print(exp.start_datetime)
  20. ...
  21. 2015-06-15 14:30:50.000321
  22. 2015-06-15 14:40:02.000123

DateField truncation

  • class TruncYear(expression, output_field=None, tzinfo=None, **extra)[source]
    • kind = 'year'
  • class TruncMonth(expression, output_field=None, tzinfo=None, **extra)[source]
    • kind = 'month'
  • class TruncQuarter(expression, output_field=None, tzinfo=None, **extra)[source]
  • New in Django 2.0.

    • kind = 'quarter'
    • These are logically equivalent to Trunc('date_field', kind). They truncateall parts of the date up to kind which allows grouping or filtering dateswith less precision. expression can have an output_field of eitherDateField or DateTimeField.

Since DateFields don't have a time component, only Trunc subclassesthat deal with date-parts can be used with DateField:

  1. >>> from datetime import datetime
  2. >>> from django.db.models import Count
  3. >>> from django.db.models.functions import TruncMonth, TruncYear
  4. >>> from django.utils import timezone
  5. >>> start1 = datetime(2014, 6, 15, 14, 30, 50, 321, tzinfo=timezone.utc)
  6. >>> start2 = datetime(2015, 6, 15, 14, 40, 2, 123, tzinfo=timezone.utc)
  7. >>> start3 = datetime(2015, 12, 31, 17, 5, 27, 999, tzinfo=timezone.utc)
  8. >>> Experiment.objects.create(start_datetime=start1, start_date=start1.date())
  9. >>> Experiment.objects.create(start_datetime=start2, start_date=start2.date())
  10. >>> Experiment.objects.create(start_datetime=start3, start_date=start3.date())
  11. >>> experiments_per_year = Experiment.objects.annotate(
  12. ... year=TruncYear('start_date')).values('year').annotate(
  13. ... experiments=Count('id'))
  14. >>> for exp in experiments_per_year:
  15. ... print(exp['year'], exp['experiments'])
  16. ...
  17. 2014-01-01 1
  18. 2015-01-01 2
  19.  
  20. >>> import pytz
  21. >>> melb = pytz.timezone('Australia/Melbourne')
  22. >>> experiments_per_month = Experiment.objects.annotate(
  23. ... month=TruncMonth('start_datetime', tzinfo=melb)).values('month').annotate(
  24. ... experiments=Count('id'))
  25. >>> for exp in experiments_per_month:
  26. ... print(exp['month'], exp['experiments'])
  27. ...
  28. 2015-06-01 00:00:00+10:00 1
  29. 2016-01-01 00:00:00+11:00 1
  30. 2014-06-01 00:00:00+10:00 1

DateTimeField truncation

  • class TruncDate(expression, **extra)[source]
    • lookup_name = 'date'
    • output_field = DateField()
    • TruncDate casts expression to a date rather than using the built-in SQLtruncate function. It's also registered as a transform on DateTimeField as__date.
  • class TruncTime(expression, **extra)[source]

  • New in Django 1.11:
  • lookup_name = 'time'
  • output_field = TimeField()

TruncTime casts expression to a time rather than using the built-in SQLtruncate function. It's also registered as a transform on DateTimeField as__time.

  • class TruncDay(expression, output_field=None, tzinfo=None, **extra)[source]
    • kind = 'day'
  • class TruncHour(expression, output_field=None, tzinfo=None, **extra)[source]
    • kind = 'hour'
  • class TruncMinute(expression, output_field=None, tzinfo=None, **extra)[source]
    • kind = 'minute'
  • class TruncSecond(expression, output_field=None, tzinfo=None, **extra)[source]
    • kind = 'second'
    • These are logically equivalent to Trunc('datetime_field', kind). Theytruncate all parts of the date up to kind and allow grouping or filteringdatetimes with less precision. expression must have an output_field ofDateTimeField.

Usage example:

  1. >>> from datetime import date, datetime
  2. >>> from django.db.models import Count
  3. >>> from django.db.models.functions import (
  4. ... TruncDate, TruncDay, TruncHour, TruncMinute, TruncSecond,
  5. ... )
  6. >>> from django.utils import timezone
  7. >>> import pytz
  8. >>> start1 = datetime(2014, 6, 15, 14, 30, 50, 321, tzinfo=timezone.utc)
  9. >>> Experiment.objects.create(start_datetime=start1, start_date=start1.date())
  10. >>> melb = pytz.timezone('Australia/Melbourne')
  11. >>> Experiment.objects.annotate(
  12. ... date=TruncDate('start_datetime'),
  13. ... day=TruncDay('start_datetime', tzinfo=melb),
  14. ... hour=TruncHour('start_datetime', tzinfo=melb),
  15. ... minute=TruncMinute('start_datetime'),
  16. ... second=TruncSecond('start_datetime'),
  17. ... ).values('date', 'day', 'hour', 'minute', 'second').get()
  18. {'date': datetime.date(2014, 6, 15),
  19. 'day': datetime.datetime(2014, 6, 16, 0, 0, tzinfo=<DstTzInfo 'Australia/Melbourne' AEST+10:00:00 STD>),
  20. 'hour': datetime.datetime(2014, 6, 16, 0, 0, tzinfo=<DstTzInfo 'Australia/Melbourne' AEST+10:00:00 STD>),
  21. 'minute': 'minute': datetime.datetime(2014, 6, 15, 14, 30, tzinfo=<UTC>),
  22. 'second': datetime.datetime(2014, 6, 15, 14, 30, 50, tzinfo=<UTC>)
  23. }

TimeField truncation

New in Django 1.11.

  • class TruncHour(expression, output_field=None, tzinfo=None, **extra)[source]
    • kind = 'hour'
  • class TruncMinute(expression, output_field=None, tzinfo=None, **extra)[source]
    • kind = 'minute'
  • class TruncSecond(expression, output_field=None, tzinfo=None, **extra)[source]
    • kind = 'second'
    • These are logically equivalent to Trunc('time_field', kind). They truncateall parts of the time up to kind which allows grouping or filtering timeswith less precision. expression can have an output_field of eitherTimeField or DateTimeField.

Since TimeFields don't have a date component, only Trunc subclassesthat deal with time-parts can be used with TimeField:

  1. >>> from datetime import datetime
  2. >>> from django.db.models import Count, TimeField
  3. >>> from django.db.models.functions import TruncHour
  4. >>> from django.utils import timezone
  5. >>> start1 = datetime(2014, 6, 15, 14, 30, 50, 321, tzinfo=timezone.utc)
  6. >>> start2 = datetime(2014, 6, 15, 14, 40, 2, 123, tzinfo=timezone.utc)
  7. >>> start3 = datetime(2015, 12, 31, 17, 5, 27, 999, tzinfo=timezone.utc)
  8. >>> Experiment.objects.create(start_datetime=start1, start_time=start1.time())
  9. >>> Experiment.objects.create(start_datetime=start2, start_time=start2.time())
  10. >>> Experiment.objects.create(start_datetime=start3, start_time=start3.time())
  11. >>> experiments_per_hour = Experiment.objects.annotate(
  12. ... hour=TruncHour('start_datetime', output_field=TimeField()),
  13. ... ).values('hour').annotate(experiments=Count('id'))
  14. >>> for exp in experiments_per_hour:
  15. ... print(exp['hour'], exp['experiments'])
  16. ...
  17. 14:00:00 2
  18. 17:00:00 1
  19.  
  20. >>> import pytz
  21. >>> melb = pytz.timezone('Australia/Melbourne')
  22. >>> experiments_per_hour = Experiment.objects.annotate(
  23. ... hour=TruncHour('start_datetime', tzinfo=melb),
  24. ... ).values('hour').annotate(experiments=Count('id'))
  25. >>> for exp in experiments_per_hour:
  26. ... print(exp['hour'], exp['experiments'])
  27. ...
  28. 2014-06-16 00:00:00+10:00 2
  29. 2016-01-01 04:00:00+11:00 1

Text functions

Concat

  • class Concat(*expressions, **extra)[source]
  • Accepts a list of at least two text fields or expressions and returns theconcatenated text. Each argument must be of a text or char type. If you wantto concatenate a TextField() with a CharField(), then be sure to tellDjango that the output_field should be a TextField(). Specifying anoutput_field is also required when concatenating a Value as in theexample below.

This function will never have a null result. On backends where a null argumentresults in the entire expression being null, Django will ensure that each nullpart is converted to an empty string first.

Usage example:

  1. >>> # Get the display name as "name (goes_by)"
  2. >>> from django.db.models import CharField, Value as V
  3. >>> from django.db.models.functions import Concat
  4. >>> Author.objects.create(name='Margaret Smith', goes_by='Maggie')
  5. >>> author = Author.objects.annotate(
  6. ... screen_name=Concat(
  7. ... 'name', V(' ('), 'goes_by', V(')'),
  8. ... output_field=CharField()
  9. ... )
  10. ... ).get()
  11. >>> print(author.screen_name)
  12. Margaret Smith (Maggie)

Length

  • class Length(expression, **extra)[source]
  • Accepts a single text field or expression and returns the number of charactersthe value has. If the expression is null, then the length will also be null.

Usage example:

  1. >>> # Get the length of the name and goes_by fields
  2. >>> from django.db.models.functions import Length
  3. >>> Author.objects.create(name='Margaret Smith')
  4. >>> author = Author.objects.annotate(
  5. ... name_length=Length('name'),
  6. ... goes_by_length=Length('goes_by')).get()
  7. >>> print(author.name_length, author.goes_by_length)
  8. (14, None)

It can also be registered as a transform. For example:

  1. >>> from django.db.models import CharField
  2. >>> from django.db.models.functions import Length
  3. >>> CharField.register_lookup(Length, 'length')
  4. >>> # Get authors whose name is longer than 7 characters
  5. >>> authors = Author.objects.filter(name__length__gt=7)

Lower

  • class Lower(expression, **extra)[source]
  • Accepts a single text field or expression and returns the lowercaserepresentation.

It can also be registered as a transform as described in Length.

Usage example:

  1. >>> from django.db.models.functions import Lower
  2. >>> Author.objects.create(name='Margaret Smith')
  3. >>> author = Author.objects.annotate(name_lower=Lower('name')).get()
  4. >>> print(author.name_lower)
  5. margaret smith

StrIndex

  • class StrIndex(string, substring, **extra)[source]
  • New in Django 2.0.

Returns a positive integer corresponding to the 1-indexed position of the firstoccurrence of substring inside string, or 0 if substring is notfound.

Usage example:

  1. >>> from django.db.models import Value as V
  2. >>> from django.db.models.functions import StrIndex
  3. >>> Author.objects.create(name='Margaret Smith')
  4. >>> Author.objects.create(name='Smith, Margaret')
  5. >>> Author.objects.create(name='Margaret Jackson')
  6. >>> Author.objects.filter(name='Margaret Jackson').annotate(
  7. ... smith_index=StrIndex('name', V('Smith'))
  8. ... ).get().smith_index
  9. 0
  10. >>> authors = Author.objects.annotate(
  11. ... smith_index=StrIndex('name', V('Smith'))
  12. ... ).filter(smith_index__gt=0)
  13. <QuerySet [<Author: Margaret Smith>, <Author: Smith, Margaret>]>

Warning

In MySQL, a database table's collation determineswhether string comparisons (such as the expression and substring ofthis function) are case-sensitive. Comparisons are case-insensitive bydefault.

Substr

  • class Substr(expression, pos, length=None, **extra)[source]
  • Returns a substring of length length from the field or expression startingat position pos. The position is 1-indexed, so the position must be greaterthan 0. If length is None, then the rest of the string will be returned.

Usage example:

  1. >>> # Set the alias to the first 5 characters of the name as lowercase
  2. >>> from django.db.models.functions import Lower, Substr
  3. >>> Author.objects.create(name='Margaret Smith')
  4. >>> Author.objects.update(alias=Lower(Substr('name', 1, 5)))
  5. 1
  6. >>> print(Author.objects.get(name='Margaret Smith').alias)
  7. marga

Upper

  • class Upper(expression, **extra)[source]
  • Accepts a single text field or expression and returns the uppercaserepresentation.

It can also be registered as a transform as described in Length.

Usage example:

  1. >>> from django.db.models.functions import Upper
  2. >>> Author.objects.create(name='Margaret Smith')
  3. >>> author = Author.objects.annotate(name_upper=Upper('name')).get()
  4. >>> print(author.name_upper)
  5. MARGARET SMITH

Window functions

New in Django 2.0.

There are a number of functions to use in aWindow expression for computing the rankof elements or the Ntile of some rows.

CumeDist

  • class CumeDist(*expressions, **extra)[source]
  • Calculates the cumulative distribution of a value within a window or partition.The cumulative distribution is defined as the number of rows preceding orpeered with the current row divided by the total number of rows in the frame.

DenseRank

  • class DenseRank(*expressions, **extra)[source]
  • Equivalent to Rank but does not have gaps.

FirstValue

  • class FirstValue(expression, **extra)[source]
  • Returns the value evaluated at the row that's the first row of the windowframe, or None if no such value exists.

Lag

  • class Lag(expression, offset=1, default=None, **extra)[source]
  • Calculates the value offset by offset, and if no row exists there, returnsdefault.

default must have the same type as the expression, however, this isonly validated by the database and not in Python.

LastValue

  • class LastValue(expression, **extra)[source]
  • Comparable to FirstValue, it calculates the last value in a givenframe clause.

Lead

  • class Lead(expression, offset=1, default=None, **extra)[source]
  • Calculates the leading value in a given frame. Bothoffset and default are evaluated with respect to the current row.

default must have the same type as the expression, however, this isonly validated by the database and not in Python.

NthValue

  • class NthValue(expression, nth=1, **extra)[source]
  • Computes the row relative to the offset nth (must be a positive value)within the window. Returns None if no row exists.

Some databases may handle a nonexistent nth-value differently. For example,Oracle returns an empty string rather than None for character-basedexpressions. Django doesn't do any conversions in these cases.

Ntile

  • class Ntile(num_buckets=1, **extra)[source]
  • Calculates a partition for each of the rows in the frame clause, distributingnumbers as evenly as possible between 1 and num_buckets. If the rows don'tdivide evenly into a number of buckets, one or more buckets will be representedmore frequently.

PercentRank

  • class PercentRank(*expressions, **extra)[source]
  • Computes the percentile rank of the rows in the frame clause. Thiscomputation is equivalent to evaluating:
  1. (rank - 1) / (total rows - 1)

The following table explains the calculation for the percentile rank of a row:

Row #ValueRankCalculationPercent Rank
1151(1-1)/(7-1)0.0000
2202(2-1)/(7-1)0.1666
3202(2-1)/(7-1)0.1666
4202(2-1)/(7-1)0.1666
5305(5-1)/(7-1)0.6666
6305(5-1)/(7-1)0.6666
7407(7-1)/(7-1)1.0000

Rank

  • class Rank(*expressions, **extra)[source]
  • Comparable to RowNumber, this function ranks rows in the window. Thecomputed rank contains gaps. Use DenseRank to compute rank withoutgaps.

RowNumber

  • class RowNumber(*expressions, **extra)[source]
  • Computes the row number according to the ordering of either the frame clauseor the ordering of the whole query if there is no partitioning of thewindow frame.