blob: 748f6582defcf41e8a188cb60f781d4efad47c18 [file] [log] [blame]
drha059ad02001-04-17 20:09:11 +00001/*
drh9e572e62004-04-23 23:43:10 +00002** 2004 April 6
drha059ad02001-04-17 20:09:11 +00003**
drhb19a2bc2001-09-16 00:13:26 +00004** The author disclaims copyright to this source code. In place of
5** a legal notice, here is a blessing:
drha059ad02001-04-17 20:09:11 +00006**
drhb19a2bc2001-09-16 00:13:26 +00007** May you do good and not evil.
8** May you find forgiveness for yourself and forgive others.
9** May you share freely, never taking more than you give.
drha059ad02001-04-17 20:09:11 +000010**
11*************************************************************************
danielk1977599fcba2004-11-08 07:13:13 +000012** $Id: btree.c,v 1.214 2004/11/08 07:13:14 danielk1977 Exp $
drh8b2f49b2001-06-08 00:21:52 +000013**
14** This file implements a external (disk-based) database using BTrees.
15** For a detailed discussion of BTrees, refer to
16**
17** Donald E. Knuth, THE ART OF COMPUTER PROGRAMMING, Volume 3:
18** "Sorting And Searching", pages 473-480. Addison-Wesley
19** Publishing Company, Reading, Massachusetts.
20**
21** The basic idea is that each page of the file contains N database
22** entries and N+1 pointers to subpages.
23**
24** ----------------------------------------------------------------
25** | Ptr(0) | Key(0) | Ptr(1) | Key(1) | ... | Key(N) | Ptr(N+1) |
26** ----------------------------------------------------------------
27**
28** All of the keys on the page that Ptr(0) points to have values less
29** than Key(0). All of the keys on page Ptr(1) and its subpages have
30** values greater than Key(0) and less than Key(1). All of the keys
31** on Ptr(N+1) and its subpages have values greater than Key(N). And
32** so forth.
33**
drh5e00f6c2001-09-13 13:46:56 +000034** Finding a particular key requires reading O(log(M)) pages from the
35** disk where M is the number of entries in the tree.
drh8b2f49b2001-06-08 00:21:52 +000036**
37** In this implementation, a single file can hold one or more separate
38** BTrees. Each BTree is identified by the index of its root page. The
drh9e572e62004-04-23 23:43:10 +000039** key and data for any entry are combined to form the "payload". A
40** fixed amount of payload can be carried directly on the database
41** page. If the payload is larger than the preset amount then surplus
42** bytes are stored on overflow pages. The payload for an entry
43** and the preceding pointer are combined to form a "Cell". Each
44** page has a small header which contains the Ptr(N+1) pointer and other
45** information such as the size of key and data.
drh8b2f49b2001-06-08 00:21:52 +000046**
drh9e572e62004-04-23 23:43:10 +000047** FORMAT DETAILS
48**
49** The file is divided into pages. The first page is called page 1,
50** the second is page 2, and so forth. A page number of zero indicates
51** "no such page". The page size can be anything between 512 and 65536.
52** Each page can be either a btree page, a freelist page or an overflow
53** page.
54**
55** The first page is always a btree page. The first 100 bytes of the first
drh271efa52004-05-30 19:19:05 +000056** page contain a special header (the "file header") that describes the file.
57** The format of the file header is as follows:
drh9e572e62004-04-23 23:43:10 +000058**
59** OFFSET SIZE DESCRIPTION
drhde647132004-05-07 17:57:49 +000060** 0 16 Header string: "SQLite format 3\000"
drh9e572e62004-04-23 23:43:10 +000061** 16 2 Page size in bytes.
62** 18 1 File format write version
63** 19 1 File format read version
drh6f11bef2004-05-13 01:12:56 +000064** 20 1 Bytes of unused space at the end of each page
65** 21 1 Max embedded payload fraction
66** 22 1 Min embedded payload fraction
67** 23 1 Min leaf payload fraction
68** 24 4 File change counter
69** 28 4 Reserved for future use
drh9e572e62004-04-23 23:43:10 +000070** 32 4 First freelist page
71** 36 4 Number of freelist pages in the file
72** 40 60 15 4-byte meta values passed to higher layers
73**
74** All of the integer values are big-endian (most significant byte first).
drh6f11bef2004-05-13 01:12:56 +000075**
drhab01f612004-05-22 02:55:23 +000076** The file change counter is incremented when the database is changed more
drh6f11bef2004-05-13 01:12:56 +000077** than once within the same second. This counter, together with the
78** modification time of the file, allows other processes to know
79** when the file has changed and thus when they need to flush their
80** cache.
81**
82** The max embedded payload fraction is the amount of the total usable
83** space in a page that can be consumed by a single cell for standard
84** B-tree (non-LEAFDATA) tables. A value of 255 means 100%. The default
85** is to limit the maximum cell size so that at least 4 cells will fit
drhab01f612004-05-22 02:55:23 +000086** on one page. Thus the default max embedded payload fraction is 64.
drh6f11bef2004-05-13 01:12:56 +000087**
88** If the payload for a cell is larger than the max payload, then extra
89** payload is spilled to overflow pages. Once an overflow page is allocated,
90** as many bytes as possible are moved into the overflow pages without letting
91** the cell size drop below the min embedded payload fraction.
92**
93** The min leaf payload fraction is like the min embedded payload fraction
94** except that it applies to leaf nodes in a LEAFDATA tree. The maximum
95** payload fraction for a LEAFDATA tree is always 100% (or 255) and it
96** not specified in the header.
drh9e572e62004-04-23 23:43:10 +000097**
drh43605152004-05-29 21:46:49 +000098** Each btree pages is divided into three sections: The header, the
99** cell pointer array, and the cell area area. Page 1 also has a 100-byte
drh271efa52004-05-30 19:19:05 +0000100** file header that occurs before the page header.
101**
102** |----------------|
103** | file header | 100 bytes. Page 1 only.
104** |----------------|
105** | page header | 8 bytes for leaves. 12 bytes for interior nodes
106** |----------------|
107** | cell pointer | | 2 bytes per cell. Sorted order.
108** | array | | Grows downward
109** | | v
110** |----------------|
111** | unallocated |
112** | space |
113** |----------------| ^ Grows upwards
114** | cell content | | Arbitrary order interspersed with freeblocks.
115** | area | | and free space fragments.
116** |----------------|
drh43605152004-05-29 21:46:49 +0000117**
118** The page headers looks like this:
drh9e572e62004-04-23 23:43:10 +0000119**
120** OFFSET SIZE DESCRIPTION
drh6f11bef2004-05-13 01:12:56 +0000121** 0 1 Flags. 1: intkey, 2: zerodata, 4: leafdata, 8: leaf
drh9e572e62004-04-23 23:43:10 +0000122** 1 2 byte offset to the first freeblock
drh43605152004-05-29 21:46:49 +0000123** 3 2 number of cells on this page
drh271efa52004-05-30 19:19:05 +0000124** 5 2 first byte of the cell content area
drh43605152004-05-29 21:46:49 +0000125** 7 1 number of fragmented free bytes
drh271efa52004-05-30 19:19:05 +0000126** 8 4 Right child (the Ptr(N+1) value). Omitted on leaves.
drh9e572e62004-04-23 23:43:10 +0000127**
128** The flags define the format of this btree page. The leaf flag means that
129** this page has no children. The zerodata flag means that this page carries
drh44f87bd2004-09-27 13:19:51 +0000130** only keys and no data. The intkey flag means that the key is a integer
131** which is stored in the key size entry of the cell header rather than in
132** the payload area.
drh9e572e62004-04-23 23:43:10 +0000133**
drh43605152004-05-29 21:46:49 +0000134** The cell pointer array begins on the first byte after the page header.
135** The cell pointer array contains zero or more 2-byte numbers which are
136** offsets from the beginning of the page to the cell content in the cell
137** content area. The cell pointers occur in sorted order. The system strives
138** to keep free space after the last cell pointer so that new cells can
drh44f87bd2004-09-27 13:19:51 +0000139** be easily added without having to defragment the page.
drh43605152004-05-29 21:46:49 +0000140**
141** Cell content is stored at the very end of the page and grows toward the
142** beginning of the page.
143**
144** Unused space within the cell content area is collected into a linked list of
145** freeblocks. Each freeblock is at least 4 bytes in size. The byte offset
146** to the first freeblock is given in the header. Freeblocks occur in
147** increasing order. Because a freeblock must be at least 4 bytes in size,
148** any group of 3 or fewer unused bytes in the cell content area cannot
149** exist on the freeblock chain. A group of 3 or fewer free bytes is called
150** a fragment. The total number of bytes in all fragments is recorded.
151** in the page header at offset 7.
152**
153** SIZE DESCRIPTION
154** 2 Byte offset of the next freeblock
155** 2 Bytes in this freeblock
156**
157** Cells are of variable length. Cells are stored in the cell content area at
158** the end of the page. Pointers to the cells are in the cell pointer array
159** that immediately follows the page header. Cells is not necessarily
160** contiguous or in order, but cell pointers are contiguous and in order.
161**
162** Cell content makes use of variable length integers. A variable
163** length integer is 1 to 9 bytes where the lower 7 bits of each
drh9e572e62004-04-23 23:43:10 +0000164** byte are used. The integer consists of all bytes that have bit 8 set and
drh6f11bef2004-05-13 01:12:56 +0000165** the first byte with bit 8 clear. The most significant byte of the integer
drhab01f612004-05-22 02:55:23 +0000166** appears first. A variable-length integer may not be more than 9 bytes long.
167** As a special case, all 8 bytes of the 9th byte are used as data. This
168** allows a 64-bit integer to be encoded in 9 bytes.
drh9e572e62004-04-23 23:43:10 +0000169**
170** 0x00 becomes 0x00000000
drh6f11bef2004-05-13 01:12:56 +0000171** 0x7f becomes 0x0000007f
172** 0x81 0x00 becomes 0x00000080
173** 0x82 0x00 becomes 0x00000100
174** 0x80 0x7f becomes 0x0000007f
175** 0x8a 0x91 0xd1 0xac 0x78 becomes 0x12345678
drh9e572e62004-04-23 23:43:10 +0000176** 0x81 0x81 0x81 0x81 0x01 becomes 0x10204081
177**
178** Variable length integers are used for rowids and to hold the number of
179** bytes of key and data in a btree cell.
180**
drh43605152004-05-29 21:46:49 +0000181** The content of a cell looks like this:
drh9e572e62004-04-23 23:43:10 +0000182**
183** SIZE DESCRIPTION
drh3aac2dd2004-04-26 14:10:20 +0000184** 4 Page number of the left child. Omitted if leaf flag is set.
185** var Number of bytes of data. Omitted if the zerodata flag is set.
186** var Number of bytes of key. Or the key itself if intkey flag is set.
drh9e572e62004-04-23 23:43:10 +0000187** * Payload
188** 4 First page of the overflow chain. Omitted if no overflow
189**
190** Overflow pages form a linked list. Each page except the last is completely
191** filled with data (pagesize - 4 bytes). The last page can have as little
192** as 1 byte of data.
193**
194** SIZE DESCRIPTION
195** 4 Page number of next overflow page
196** * Data
197**
198** Freelist pages come in two subtypes: trunk pages and leaf pages. The
199** file header points to first in a linked list of trunk page. Each trunk
200** page points to multiple leaf pages. The content of a leaf page is
201** unspecified. A trunk page looks like this:
202**
203** SIZE DESCRIPTION
204** 4 Page number of next trunk page
205** 4 Number of leaf pointers on this page
206** * zero or more pages numbers of leaves
drha059ad02001-04-17 20:09:11 +0000207*/
208#include "sqliteInt.h"
209#include "pager.h"
210#include "btree.h"
drh1f595712004-06-15 01:40:29 +0000211#include "os.h"
drha059ad02001-04-17 20:09:11 +0000212#include <assert.h>
213
drh887dc4c2004-10-22 16:22:57 +0000214/*
215** This macro rounds values up so that if the value is an address it
216** is guaranteed to be an address that is aligned to an 8-byte boundary.
217*/
218#define FORCE_ALIGNMENT(X) (((X)+7)&~7)
drh4b70f112004-05-02 21:12:19 +0000219
drh4b70f112004-05-02 21:12:19 +0000220/* The following value is the maximum cell size assuming a maximum page
221** size give above.
222*/
drh2e38c322004-09-03 18:38:44 +0000223#define MX_CELL_SIZE(pBt) (pBt->pageSize-8)
drh4b70f112004-05-02 21:12:19 +0000224
225/* The maximum number of cells on a single page of the database. This
226** assumes a minimum cell size of 3 bytes. Such small cells will be
227** exceedingly rare, but they are possible.
228*/
drh2e38c322004-09-03 18:38:44 +0000229#define MX_CELL(pBt) ((pBt->pageSize-8)/3)
drh4b70f112004-05-02 21:12:19 +0000230
paulb95a8862003-04-01 21:16:41 +0000231/* Forward declarations */
drh3aac2dd2004-04-26 14:10:20 +0000232typedef struct MemPage MemPage;
paulb95a8862003-04-01 21:16:41 +0000233
drh8c42ca92001-06-22 19:15:00 +0000234/*
drhbd03cae2001-06-02 02:40:57 +0000235** This is a magic string that appears at the beginning of every
drh8c42ca92001-06-22 19:15:00 +0000236** SQLite database in order to identify the file as a real database.
drhde647132004-05-07 17:57:49 +0000237** 123456789 123456 */
238static const char zMagicHeader[] = "SQLite format 3";
drh08ed44e2001-04-29 23:32:55 +0000239
240/*
drh4b70f112004-05-02 21:12:19 +0000241** Page type flags. An ORed combination of these flags appear as the
242** first byte of every BTree page.
drh8c42ca92001-06-22 19:15:00 +0000243*/
drhde647132004-05-07 17:57:49 +0000244#define PTF_INTKEY 0x01
drh9e572e62004-04-23 23:43:10 +0000245#define PTF_ZERODATA 0x02
drh8b18dd42004-05-12 19:18:15 +0000246#define PTF_LEAFDATA 0x04
247#define PTF_LEAF 0x08
drh8c42ca92001-06-22 19:15:00 +0000248
249/*
drh9e572e62004-04-23 23:43:10 +0000250** As each page of the file is loaded into memory, an instance of the following
251** structure is appended and initialized to zero. This structure stores
252** information about the page that is decoded from the raw file page.
drh14acc042001-06-10 19:56:58 +0000253**
drh72f82862001-05-24 21:06:34 +0000254** The pParent field points back to the parent page. This allows us to
255** walk up the BTree from any leaf to the root. Care must be taken to
256** unref() the parent page pointer when this page is no longer referenced.
drhbd03cae2001-06-02 02:40:57 +0000257** The pageDestructor() routine handles that chore.
drh7e3b0a02001-04-28 16:52:40 +0000258*/
259struct MemPage {
drha6abd042004-06-09 17:37:22 +0000260 u8 isInit; /* True if previously initialized. MUST BE FIRST! */
drh43605152004-05-29 21:46:49 +0000261 u8 idxShift; /* True if Cell indices have changed */
262 u8 nOverflow; /* Number of overflow cell bodies in aCell[] */
263 u8 intKey; /* True if intkey flag is set */
264 u8 leaf; /* True if leaf flag is set */
265 u8 zeroData; /* True if table stores keys only */
266 u8 leafData; /* True if tables stores data on leaves only */
267 u8 hasData; /* True if this page stores data */
268 u8 hdrOffset; /* 100 for page 1. 0 otherwise */
drh271efa52004-05-30 19:19:05 +0000269 u8 childPtrSize; /* 0 if leaf==1. 4 if leaf==0 */
drha2fce642004-06-05 00:01:44 +0000270 u16 maxLocal; /* Copy of Btree.maxLocal or Btree.maxLeaf */
271 u16 minLocal; /* Copy of Btree.minLocal or Btree.minLeaf */
drh43605152004-05-29 21:46:49 +0000272 u16 cellOffset; /* Index in aData of first cell pointer */
273 u16 idxParent; /* Index in parent of this node */
274 u16 nFree; /* Number of free bytes on the page */
275 u16 nCell; /* Number of cells on this page, local and ovfl */
276 struct _OvflCell { /* Cells that will not fit on aData[] */
277 u8 *pCell; /* Pointers to the body of the overflow cell */
278 u16 idx; /* Insert this cell before idx-th non-overflow cell */
drha2fce642004-06-05 00:01:44 +0000279 } aOvfl[5];
drh43605152004-05-29 21:46:49 +0000280 struct Btree *pBt; /* Pointer back to BTree structure */
281 u8 *aData; /* Pointer back to the start of the page */
282 Pgno pgno; /* Page number for this page */
283 MemPage *pParent; /* The parent of this page. NULL for root */
drh8c42ca92001-06-22 19:15:00 +0000284};
drh7e3b0a02001-04-28 16:52:40 +0000285
286/*
drh3b7511c2001-05-26 13:15:44 +0000287** The in-memory image of a disk page has the auxiliary information appended
288** to the end. EXTRA_SIZE is the number of bytes of space needed to hold
289** that extra information.
290*/
drh3aac2dd2004-04-26 14:10:20 +0000291#define EXTRA_SIZE sizeof(MemPage)
drh3b7511c2001-05-26 13:15:44 +0000292
293/*
drha059ad02001-04-17 20:09:11 +0000294** Everything we need to know about an open database
295*/
296struct Btree {
297 Pager *pPager; /* The page cache */
drh306dc212001-05-21 13:45:10 +0000298 BtCursor *pCursor; /* A list of all open cursors */
drh3aac2dd2004-04-26 14:10:20 +0000299 MemPage *pPage1; /* First page of the database */
drh663fc632002-02-02 18:49:19 +0000300 u8 inTrans; /* True if a transaction is in progress */
drhab01f612004-05-22 02:55:23 +0000301 u8 inStmt; /* True if we are in a statement subtransaction */
drh5df72a52002-06-06 23:16:05 +0000302 u8 readOnly; /* True if the underlying file is readonly */
drhab01f612004-05-22 02:55:23 +0000303 u8 maxEmbedFrac; /* Maximum payload as % of total page size */
304 u8 minEmbedFrac; /* Minimum payload as % of total page size */
305 u8 minLeafFrac; /* Minimum leaf payload as % of total page size */
drh90f5ecb2004-07-22 01:19:35 +0000306 u8 pageSizeFixed; /* True if the page size can no longer be changed */
drha2fce642004-06-05 00:01:44 +0000307 u16 pageSize; /* Total number of bytes on a page */
drh887dc4c2004-10-22 16:22:57 +0000308 u16 psAligned; /* pageSize rounded up to a multiple of 8 */
drha2fce642004-06-05 00:01:44 +0000309 u16 usableSize; /* Number of usable bytes on each page */
drh6f11bef2004-05-13 01:12:56 +0000310 int maxLocal; /* Maximum local payload in non-LEAFDATA tables */
311 int minLocal; /* Minimum local payload in non-LEAFDATA tables */
312 int maxLeaf; /* Maximum local payload in a LEAFDATA table */
313 int minLeaf; /* Minimum local payload in a LEAFDATA table */
danielk1977afcdd022004-10-31 16:25:42 +0000314#ifndef SQLITE_OMIT_AUTOVACUUM
315 u8 autoVacuum; /* True if database supports auto-vacuum */
316#endif
drha059ad02001-04-17 20:09:11 +0000317};
318typedef Btree Bt;
319
drh365d68f2001-05-11 11:02:46 +0000320/*
danielk1977ee5741e2004-05-31 10:01:34 +0000321** Btree.inTrans may take one of the following values.
322*/
323#define TRANS_NONE 0
324#define TRANS_READ 1
325#define TRANS_WRITE 2
326
327/*
drhfa1a98a2004-05-14 19:08:17 +0000328** An instance of the following structure is used to hold information
drh271efa52004-05-30 19:19:05 +0000329** about a cell. The parseCellPtr() function fills in this structure
drhab01f612004-05-22 02:55:23 +0000330** based on information extract from the raw disk page.
drhfa1a98a2004-05-14 19:08:17 +0000331*/
332typedef struct CellInfo CellInfo;
333struct CellInfo {
drh43605152004-05-29 21:46:49 +0000334 u8 *pCell; /* Pointer to the start of cell content */
drhfa1a98a2004-05-14 19:08:17 +0000335 i64 nKey; /* The key for INTKEY tables, or number of bytes in key */
336 u32 nData; /* Number of bytes of data */
drh271efa52004-05-30 19:19:05 +0000337 u16 nHeader; /* Size of the cell content header in bytes */
drhfa1a98a2004-05-14 19:08:17 +0000338 u16 nLocal; /* Amount of payload held locally */
drhab01f612004-05-22 02:55:23 +0000339 u16 iOverflow; /* Offset to overflow page number. Zero if no overflow */
drh271efa52004-05-30 19:19:05 +0000340 u16 nSize; /* Size of the cell content on the main b-tree page */
drhfa1a98a2004-05-14 19:08:17 +0000341};
342
343/*
drh365d68f2001-05-11 11:02:46 +0000344** A cursor is a pointer to a particular entry in the BTree.
345** The entry is identified by its MemPage and the index in
drha34b6762004-05-07 13:30:42 +0000346** MemPage.aCell[] of the entry.
drh365d68f2001-05-11 11:02:46 +0000347*/
drh72f82862001-05-24 21:06:34 +0000348struct BtCursor {
drh5e2f8b92001-05-28 00:41:15 +0000349 Btree *pBt; /* The Btree to which this cursor belongs */
drh14acc042001-06-10 19:56:58 +0000350 BtCursor *pNext, *pPrev; /* Forms a linked list of all cursors */
drh3aac2dd2004-04-26 14:10:20 +0000351 int (*xCompare)(void*,int,const void*,int,const void*); /* Key comp func */
352 void *pArg; /* First arg to xCompare() */
drh8b2f49b2001-06-08 00:21:52 +0000353 Pgno pgnoRoot; /* The root page of this tree */
drh5e2f8b92001-05-28 00:41:15 +0000354 MemPage *pPage; /* Page that contains the entry */
drh3aac2dd2004-04-26 14:10:20 +0000355 int idx; /* Index of the entry in pPage->aCell[] */
drhfa1a98a2004-05-14 19:08:17 +0000356 CellInfo info; /* A parse of the cell we are pointing at */
drhecdc7532001-09-23 02:35:53 +0000357 u8 wrFlag; /* True if writable */
drhc39e0002004-05-07 23:50:57 +0000358 u8 isValid; /* TRUE if points to a valid entry */
359 u8 status; /* Set to SQLITE_ABORT if cursors is invalidated */
drh365d68f2001-05-11 11:02:46 +0000360};
drh7e3b0a02001-04-28 16:52:40 +0000361
drha059ad02001-04-17 20:09:11 +0000362/*
drh66cbd152004-09-01 16:12:25 +0000363** Forward declaration
364*/
365static int checkReadLocks(Btree*,Pgno,BtCursor*);
366
367
368/*
drhab01f612004-05-22 02:55:23 +0000369** Read or write a two- and four-byte big-endian integer values.
drh0d316a42002-08-11 20:10:47 +0000370*/
drh9e572e62004-04-23 23:43:10 +0000371static u32 get2byte(unsigned char *p){
372 return (p[0]<<8) | p[1];
drh0d316a42002-08-11 20:10:47 +0000373}
drh9e572e62004-04-23 23:43:10 +0000374static u32 get4byte(unsigned char *p){
375 return (p[0]<<24) | (p[1]<<16) | (p[2]<<8) | p[3];
376}
drh9e572e62004-04-23 23:43:10 +0000377static void put2byte(unsigned char *p, u32 v){
378 p[0] = v>>8;
379 p[1] = v;
380}
381static void put4byte(unsigned char *p, u32 v){
382 p[0] = v>>24;
383 p[1] = v>>16;
384 p[2] = v>>8;
385 p[3] = v;
386}
drh6f11bef2004-05-13 01:12:56 +0000387
drh9e572e62004-04-23 23:43:10 +0000388/*
drhab01f612004-05-22 02:55:23 +0000389** Routines to read and write variable-length integers. These used to
390** be defined locally, but now we use the varint routines in the util.c
391** file.
drh9e572e62004-04-23 23:43:10 +0000392*/
drh6d2fb152004-05-14 16:50:06 +0000393#define getVarint sqlite3GetVarint
394#define getVarint32 sqlite3GetVarint32
395#define putVarint sqlite3PutVarint
drh0d316a42002-08-11 20:10:47 +0000396
danielk1977599fcba2004-11-08 07:13:13 +0000397/* The database page the PENDING_BYTE occupies. This page is never used.
398** TODO: This macro is very similary to PAGER_MJ_PGNO() in pager.c. They
399** should possibly be consolidated (presumably in pager.h).
400*/
401#define PENDING_BYTE_PAGE(pBt) ((PENDING_BYTE/(pBt)->pageSize)+1)
danielk1977afcdd022004-10-31 16:25:42 +0000402
danielk1977599fcba2004-11-08 07:13:13 +0000403#ifndef SQLITE_OMIT_AUTOVACUUM
danielk1977afcdd022004-10-31 16:25:42 +0000404/*
405** These two macros define the location of the pointer-map entry for a
406** database page. The first argument to each is the page size used
407** by the database (often 1024). The second is the page number to look
408** up in the pointer map.
409**
410** PTRMAP_PAGENO returns the database page number of the pointer-map
411** page that stores the required pointer. PTRMAP_PTROFFSET returns
412** the offset of the requested map entry.
413**
414** If the pgno argument passed to PTRMAP_PAGENO is a pointer-map page,
415** then pgno is returned. So (pgno==PTRMAP_PAGENO(pgsz, pgno)) can be
danielk1977599fcba2004-11-08 07:13:13 +0000416** used to test if pgno is a pointer-map page. PTRMAP_ISPAGE implements
417** this test.
danielk1977afcdd022004-10-31 16:25:42 +0000418*/
419#define PTRMAP_PAGENO(pgsz, pgno) (((pgno-2)/(pgsz/5+1))*(pgsz/5+1)+2)
420#define PTRMAP_PTROFFSET(pgsz, pgno) (((pgno-2)%(pgsz/5+1)-1)*5)
danielk1977a19df672004-11-03 11:37:07 +0000421#define PTRMAP_ISPAGE(pgsz, pgno) (PTRMAP_PAGENO(pgsz,pgno)==pgno)
422
danielk1977afcdd022004-10-31 16:25:42 +0000423/*
danielk1977687566d2004-11-02 12:56:41 +0000424** The pointer map is a lookup table that contains an entry for each database
425** page in the file except for page 1. In this context 'database page' refers
426** to any page that is not part of the pointer map itself. Each pointer map
427** entry consists of a single byte 'type' and a 4 byte page number. The
428** PTRMAP_XXX identifiers below are the valid types. The interpretation
429** of the page-number depends on the type, as follows:
danielk1977afcdd022004-10-31 16:25:42 +0000430**
danielk1977687566d2004-11-02 12:56:41 +0000431** PTRMAP_ROOTPAGE: The database page is a root-page. The page-number is not
432** used in this case.
danielk1977afcdd022004-10-31 16:25:42 +0000433**
danielk1977687566d2004-11-02 12:56:41 +0000434** PTRMAP_FREEPAGE: The database page is an unused (free) page. The page-number
435** is not used in this case.
436**
437** PTRMAP_OVERFLOW1: The database page is the first page in a list of
438** overflow pages. The page number identifies the page that
439** contains the cell with a pointer to this overflow page.
440**
441** PTRMAP_OVERFLOW2: The database page is the second or later page in a list of
442** overflow pages. The page-number identifies the previous
443** page in the overflow page list.
444**
445** PTRMAP_BTREE: The database page is a non-root btree page. The page number
446** identifies the parent page in the btree.
danielk1977afcdd022004-10-31 16:25:42 +0000447*/
danielk1977687566d2004-11-02 12:56:41 +0000448#define PTRMAP_ROOTPAGE 1
449#define PTRMAP_FREEPAGE 2
450#define PTRMAP_OVERFLOW1 3
451#define PTRMAP_OVERFLOW2 4
452#define PTRMAP_BTREE 5
danielk1977afcdd022004-10-31 16:25:42 +0000453
454/*
455** Write an entry into the pointer map.
danielk1977687566d2004-11-02 12:56:41 +0000456**
457** This routine updates the pointer map entry for page number 'key'
458** so that it maps to type 'eType' and parent page number 'pgno'.
459** An error code is returned if something goes wrong, otherwise SQLITE_OK.
danielk1977afcdd022004-10-31 16:25:42 +0000460*/
461static int ptrmapPut(Btree *pBt, Pgno key, u8 eType, Pgno pgno){
462 u8 *pPtrmap; /* The pointer map page */
463 Pgno iPtrmap; /* The pointer map page number */
464 int offset; /* Offset in pointer map page */
465 int rc;
466
danielk1977599fcba2004-11-08 07:13:13 +0000467 assert( key!=0 );
danielk1977afcdd022004-10-31 16:25:42 +0000468 iPtrmap = PTRMAP_PAGENO(pBt->pageSize, key);
469 rc = sqlite3pager_get(pBt->pPager, iPtrmap, (void **)&pPtrmap);
danielk1977687566d2004-11-02 12:56:41 +0000470 if( rc!=SQLITE_OK ){
danielk1977afcdd022004-10-31 16:25:42 +0000471 return rc;
472 }
473 offset = PTRMAP_PTROFFSET(pBt->pageSize, key);
474
475 if( eType!=pPtrmap[offset] || get4byte(&pPtrmap[offset+1])!=pgno ){
476 rc = sqlite3pager_write(pPtrmap);
477 if( rc!=0 ){
478 return rc;
479 }
480 pPtrmap[offset] = eType;
481 put4byte(&pPtrmap[offset+1], pgno);
482 }
483
484 sqlite3pager_unref(pPtrmap);
485 return SQLITE_OK;
486}
487
488/*
489** Read an entry from the pointer map.
danielk1977687566d2004-11-02 12:56:41 +0000490**
491** This routine retrieves the pointer map entry for page 'key', writing
492** the type and parent page number to *pEType and *pPgno respectively.
493** An error code is returned if something goes wrong, otherwise SQLITE_OK.
danielk1977afcdd022004-10-31 16:25:42 +0000494*/
495static int ptrmapGet(Btree *pBt, Pgno key, u8 *pEType, Pgno *pPgno){
496 int iPtrmap; /* Pointer map page index */
497 u8 *pPtrmap; /* Pointer map page data */
498 int offset; /* Offset of entry in pointer map */
499 int rc;
500
501 iPtrmap = PTRMAP_PAGENO(pBt->pageSize, key);
502 rc = sqlite3pager_get(pBt->pPager, iPtrmap, (void **)&pPtrmap);
503 if( rc!=0 ){
504 return rc;
505 }
506
507 offset = PTRMAP_PTROFFSET(pBt->pageSize, key);
danielk1977687566d2004-11-02 12:56:41 +0000508 if( pEType ) *pEType = pPtrmap[offset];
509 if( pPgno ) *pPgno = get4byte(&pPtrmap[offset+1]);
danielk1977afcdd022004-10-31 16:25:42 +0000510
511 sqlite3pager_unref(pPtrmap);
512 return SQLITE_OK;
513}
514
515#endif /* SQLITE_OMIT_AUTOVACUUM */
516
drh0d316a42002-08-11 20:10:47 +0000517/*
drh271efa52004-05-30 19:19:05 +0000518** Given a btree page and a cell index (0 means the first cell on
519** the page, 1 means the second cell, and so forth) return a pointer
520** to the cell content.
521**
522** This routine works only for pages that do not contain overflow cells.
drh3aac2dd2004-04-26 14:10:20 +0000523*/
drh43605152004-05-29 21:46:49 +0000524static u8 *findCell(MemPage *pPage, int iCell){
525 u8 *data = pPage->aData;
526 assert( iCell>=0 );
527 assert( iCell<get2byte(&data[pPage->hdrOffset+3]) );
528 return data + get2byte(&data[pPage->cellOffset+2*iCell]);
529}
530
531/*
532** This a more complex version of findCell() that works for
533** pages that do contain overflow cells. See insert
534*/
535static u8 *findOverflowCell(MemPage *pPage, int iCell){
536 int i;
537 for(i=pPage->nOverflow-1; i>=0; i--){
drh6d08b4d2004-07-20 12:45:22 +0000538 int k;
539 struct _OvflCell *pOvfl;
540 pOvfl = &pPage->aOvfl[i];
541 k = pOvfl->idx;
542 if( k<=iCell ){
543 if( k==iCell ){
544 return pOvfl->pCell;
drh43605152004-05-29 21:46:49 +0000545 }
546 iCell--;
547 }
548 }
549 return findCell(pPage, iCell);
550}
551
552/*
553** Parse a cell content block and fill in the CellInfo structure. There
554** are two versions of this function. parseCell() takes a cell index
555** as the second argument and parseCellPtr() takes a pointer to the
556** body of the cell as its second argument.
557*/
558static void parseCellPtr(
drh3aac2dd2004-04-26 14:10:20 +0000559 MemPage *pPage, /* Page containing the cell */
drh43605152004-05-29 21:46:49 +0000560 u8 *pCell, /* Pointer to the cell text. */
drh6f11bef2004-05-13 01:12:56 +0000561 CellInfo *pInfo /* Fill in this structure */
drh3aac2dd2004-04-26 14:10:20 +0000562){
drh271efa52004-05-30 19:19:05 +0000563 int n; /* Number bytes in cell content header */
564 u32 nPayload; /* Number of bytes of cell payload */
drh43605152004-05-29 21:46:49 +0000565
566 pInfo->pCell = pCell;
drhab01f612004-05-22 02:55:23 +0000567 assert( pPage->leaf==0 || pPage->leaf==1 );
drh271efa52004-05-30 19:19:05 +0000568 n = pPage->childPtrSize;
569 assert( n==4-4*pPage->leaf );
drh8b18dd42004-05-12 19:18:15 +0000570 if( pPage->hasData ){
drh271efa52004-05-30 19:19:05 +0000571 n += getVarint32(&pCell[n], &nPayload);
drh8b18dd42004-05-12 19:18:15 +0000572 }else{
drh271efa52004-05-30 19:19:05 +0000573 nPayload = 0;
drh3aac2dd2004-04-26 14:10:20 +0000574 }
danielk1977e0d4b062004-06-28 01:11:46 +0000575 n += getVarint(&pCell[n], (u64 *)&pInfo->nKey);
drh6f11bef2004-05-13 01:12:56 +0000576 pInfo->nHeader = n;
drh271efa52004-05-30 19:19:05 +0000577 pInfo->nData = nPayload;
drh6f11bef2004-05-13 01:12:56 +0000578 if( !pPage->intKey ){
579 nPayload += pInfo->nKey;
580 }
drh271efa52004-05-30 19:19:05 +0000581 if( nPayload<=pPage->maxLocal ){
582 /* This is the (easy) common case where the entire payload fits
583 ** on the local page. No overflow is required.
584 */
585 int nSize; /* Total size of cell content in bytes */
drh6f11bef2004-05-13 01:12:56 +0000586 pInfo->nLocal = nPayload;
587 pInfo->iOverflow = 0;
drh271efa52004-05-30 19:19:05 +0000588 nSize = nPayload + n;
589 if( nSize<4 ){
590 nSize = 4; /* Minimum cell size is 4 */
drh43605152004-05-29 21:46:49 +0000591 }
drh271efa52004-05-30 19:19:05 +0000592 pInfo->nSize = nSize;
drh6f11bef2004-05-13 01:12:56 +0000593 }else{
drh271efa52004-05-30 19:19:05 +0000594 /* If the payload will not fit completely on the local page, we have
595 ** to decide how much to store locally and how much to spill onto
596 ** overflow pages. The strategy is to minimize the amount of unused
597 ** space on overflow pages while keeping the amount of local storage
598 ** in between minLocal and maxLocal.
599 **
600 ** Warning: changing the way overflow payload is distributed in any
601 ** way will result in an incompatible file format.
602 */
603 int minLocal; /* Minimum amount of payload held locally */
604 int maxLocal; /* Maximum amount of payload held locally */
605 int surplus; /* Overflow payload available for local storage */
606
607 minLocal = pPage->minLocal;
608 maxLocal = pPage->maxLocal;
609 surplus = minLocal + (nPayload - minLocal)%(pPage->pBt->usableSize - 4);
drh6f11bef2004-05-13 01:12:56 +0000610 if( surplus <= maxLocal ){
611 pInfo->nLocal = surplus;
612 }else{
613 pInfo->nLocal = minLocal;
614 }
615 pInfo->iOverflow = pInfo->nLocal + n;
616 pInfo->nSize = pInfo->iOverflow + 4;
617 }
drh3aac2dd2004-04-26 14:10:20 +0000618}
drh43605152004-05-29 21:46:49 +0000619static void parseCell(
620 MemPage *pPage, /* Page containing the cell */
621 int iCell, /* The cell index. First cell is 0 */
622 CellInfo *pInfo /* Fill in this structure */
623){
624 parseCellPtr(pPage, findCell(pPage, iCell), pInfo);
625}
drh3aac2dd2004-04-26 14:10:20 +0000626
627/*
drh43605152004-05-29 21:46:49 +0000628** Compute the total number of bytes that a Cell needs in the cell
629** data area of the btree-page. The return number includes the cell
630** data header and the local payload, but not any overflow page or
631** the space used by the cell pointer.
drh3b7511c2001-05-26 13:15:44 +0000632*/
danielk1977bc6ada42004-06-30 08:20:16 +0000633#ifndef NDEBUG
drh43605152004-05-29 21:46:49 +0000634static int cellSize(MemPage *pPage, int iCell){
drh6f11bef2004-05-13 01:12:56 +0000635 CellInfo info;
drh43605152004-05-29 21:46:49 +0000636 parseCell(pPage, iCell, &info);
637 return info.nSize;
638}
danielk1977bc6ada42004-06-30 08:20:16 +0000639#endif
drh43605152004-05-29 21:46:49 +0000640static int cellSizePtr(MemPage *pPage, u8 *pCell){
641 CellInfo info;
642 parseCellPtr(pPage, pCell, &info);
drh6f11bef2004-05-13 01:12:56 +0000643 return info.nSize;
drh3b7511c2001-05-26 13:15:44 +0000644}
645
646/*
drhda200cc2004-05-09 11:51:38 +0000647** Do sanity checking on a page. Throw an exception if anything is
648** not right.
649**
650** This routine is used for internal error checking only. It is omitted
651** from most builds.
652*/
653#if defined(BTREE_DEBUG) && !defined(NDEBUG) && 0
654static void _pageIntegrity(MemPage *pPage){
drhb6f41482004-05-14 01:58:11 +0000655 int usableSize;
drhda200cc2004-05-09 11:51:38 +0000656 u8 *data;
drh43605152004-05-29 21:46:49 +0000657 int i, j, idx, c, pc, hdr, nFree;
658 int cellOffset;
659 int nCell, cellLimit;
drh2e38c322004-09-03 18:38:44 +0000660 u8 *used;
drhda200cc2004-05-09 11:51:38 +0000661
drh2e38c322004-09-03 18:38:44 +0000662 used = sqliteMallocRaw( pPage->pBt->pageSize );
663 if( used==0 ) return;
drhb6f41482004-05-14 01:58:11 +0000664 usableSize = pPage->pBt->usableSize;
drh887dc4c2004-10-22 16:22:57 +0000665 assert( pPage->aData==&((unsigned char*)pPage)[-pPage->pBt->psAligned] );
drhda200cc2004-05-09 11:51:38 +0000666 hdr = pPage->hdrOffset;
667 assert( hdr==(pPage->pgno==1 ? 100 : 0) );
668 assert( pPage->pgno==sqlite3pager_pagenumber(pPage->aData) );
669 c = pPage->aData[hdr];
670 if( pPage->isInit ){
671 assert( pPage->leaf == ((c & PTF_LEAF)!=0) );
672 assert( pPage->zeroData == ((c & PTF_ZERODATA)!=0) );
drh8b18dd42004-05-12 19:18:15 +0000673 assert( pPage->leafData == ((c & PTF_LEAFDATA)!=0) );
674 assert( pPage->intKey == ((c & (PTF_INTKEY|PTF_LEAFDATA))!=0) );
675 assert( pPage->hasData ==
676 !(pPage->zeroData || (!pPage->leaf && pPage->leafData)) );
drh43605152004-05-29 21:46:49 +0000677 assert( pPage->cellOffset==pPage->hdrOffset+12-4*pPage->leaf );
678 assert( pPage->nCell = get2byte(&pPage->aData[hdr+3]) );
drhda200cc2004-05-09 11:51:38 +0000679 }
680 data = pPage->aData;
drhb6f41482004-05-14 01:58:11 +0000681 memset(used, 0, usableSize);
drhda200cc2004-05-09 11:51:38 +0000682 for(i=0; i<hdr+10-pPage->leaf*4; i++) used[i] = 1;
683 nFree = 0;
684 pc = get2byte(&data[hdr+1]);
685 while( pc ){
686 int size;
drhb6f41482004-05-14 01:58:11 +0000687 assert( pc>0 && pc<usableSize-4 );
drhda200cc2004-05-09 11:51:38 +0000688 size = get2byte(&data[pc+2]);
drhb6f41482004-05-14 01:58:11 +0000689 assert( pc+size<=usableSize );
drhda200cc2004-05-09 11:51:38 +0000690 nFree += size;
691 for(i=pc; i<pc+size; i++){
692 assert( used[i]==0 );
693 used[i] = 1;
694 }
695 pc = get2byte(&data[pc]);
696 }
drhda200cc2004-05-09 11:51:38 +0000697 idx = 0;
drh43605152004-05-29 21:46:49 +0000698 nCell = get2byte(&data[hdr+3]);
699 cellLimit = get2byte(&data[hdr+5]);
700 assert( pPage->isInit==0
701 || pPage->nFree==nFree+data[hdr+7]+cellLimit-(cellOffset+2*nCell) );
702 cellOffset = pPage->cellOffset;
703 for(i=0; i<nCell; i++){
drhda200cc2004-05-09 11:51:38 +0000704 int size;
drh43605152004-05-29 21:46:49 +0000705 pc = get2byte(&data[cellOffset+2*i]);
drhb6f41482004-05-14 01:58:11 +0000706 assert( pc>0 && pc<usableSize-4 );
drhda200cc2004-05-09 11:51:38 +0000707 size = cellSize(pPage, &data[pc]);
drhb6f41482004-05-14 01:58:11 +0000708 assert( pc+size<=usableSize );
drh43605152004-05-29 21:46:49 +0000709 for(j=pc; j<pc+size; j++){
710 assert( used[j]==0 );
711 used[j] = 1;
drhda200cc2004-05-09 11:51:38 +0000712 }
drhda200cc2004-05-09 11:51:38 +0000713 }
drh43605152004-05-29 21:46:49 +0000714 for(i=cellOffset+2*nCell; i<cellimit; i++){
715 assert( used[i]==0 );
716 used[i] = 1;
717 }
drhda200cc2004-05-09 11:51:38 +0000718 nFree = 0;
drhb6f41482004-05-14 01:58:11 +0000719 for(i=0; i<usableSize; i++){
drhda200cc2004-05-09 11:51:38 +0000720 assert( used[i]<=1 );
721 if( used[i]==0 ) nFree++;
722 }
drh43605152004-05-29 21:46:49 +0000723 assert( nFree==data[hdr+7] );
drh2e38c322004-09-03 18:38:44 +0000724 sqliteFree(used);
drhda200cc2004-05-09 11:51:38 +0000725}
726#define pageIntegrity(X) _pageIntegrity(X)
727#else
728# define pageIntegrity(X)
729#endif
730
731/*
drh72f82862001-05-24 21:06:34 +0000732** Defragment the page given. All Cells are moved to the
733** beginning of the page and all free space is collected
734** into one big FreeBlk at the end of the page.
drh365d68f2001-05-11 11:02:46 +0000735*/
drh2e38c322004-09-03 18:38:44 +0000736static int defragmentPage(MemPage *pPage){
drh43605152004-05-29 21:46:49 +0000737 int i; /* Loop counter */
738 int pc; /* Address of a i-th cell */
739 int addr; /* Offset of first byte after cell pointer array */
740 int hdr; /* Offset to the page header */
741 int size; /* Size of a cell */
742 int usableSize; /* Number of usable bytes on a page */
743 int cellOffset; /* Offset to the cell pointer array */
744 int brk; /* Offset to the cell content area */
745 int nCell; /* Number of cells on the page */
drh2e38c322004-09-03 18:38:44 +0000746 unsigned char *data; /* The page data */
747 unsigned char *temp; /* Temp area for cell content */
drh2af926b2001-05-15 00:39:25 +0000748
drha34b6762004-05-07 13:30:42 +0000749 assert( sqlite3pager_iswriteable(pPage->aData) );
drh9e572e62004-04-23 23:43:10 +0000750 assert( pPage->pBt!=0 );
drh90f5ecb2004-07-22 01:19:35 +0000751 assert( pPage->pBt->usableSize <= SQLITE_MAX_PAGE_SIZE );
drh43605152004-05-29 21:46:49 +0000752 assert( pPage->nOverflow==0 );
drh2e38c322004-09-03 18:38:44 +0000753 temp = sqliteMalloc( pPage->pBt->pageSize );
754 if( temp==0 ) return SQLITE_NOMEM;
drh43605152004-05-29 21:46:49 +0000755 data = pPage->aData;
drh9e572e62004-04-23 23:43:10 +0000756 hdr = pPage->hdrOffset;
drh43605152004-05-29 21:46:49 +0000757 cellOffset = pPage->cellOffset;
758 nCell = pPage->nCell;
759 assert( nCell==get2byte(&data[hdr+3]) );
760 usableSize = pPage->pBt->usableSize;
761 brk = get2byte(&data[hdr+5]);
762 memcpy(&temp[brk], &data[brk], usableSize - brk);
763 brk = usableSize;
764 for(i=0; i<nCell; i++){
765 u8 *pAddr; /* The i-th cell pointer */
766 pAddr = &data[cellOffset + i*2];
767 pc = get2byte(pAddr);
768 assert( pc<pPage->pBt->usableSize );
769 size = cellSizePtr(pPage, &temp[pc]);
770 brk -= size;
771 memcpy(&data[brk], &temp[pc], size);
772 put2byte(pAddr, brk);
drh2af926b2001-05-15 00:39:25 +0000773 }
drh43605152004-05-29 21:46:49 +0000774 assert( brk>=cellOffset+2*nCell );
775 put2byte(&data[hdr+5], brk);
776 data[hdr+1] = 0;
777 data[hdr+2] = 0;
778 data[hdr+7] = 0;
779 addr = cellOffset+2*nCell;
780 memset(&data[addr], 0, brk-addr);
drh2e38c322004-09-03 18:38:44 +0000781 sqliteFree(temp);
782 return SQLITE_OK;
drh365d68f2001-05-11 11:02:46 +0000783}
784
drha059ad02001-04-17 20:09:11 +0000785/*
drh43605152004-05-29 21:46:49 +0000786** Allocate nByte bytes of space on a page.
drhbd03cae2001-06-02 02:40:57 +0000787**
drh9e572e62004-04-23 23:43:10 +0000788** Return the index into pPage->aData[] of the first byte of
drhbd03cae2001-06-02 02:40:57 +0000789** the new allocation. Or return 0 if there is not enough free
790** space on the page to satisfy the allocation request.
drh2af926b2001-05-15 00:39:25 +0000791**
drh72f82862001-05-24 21:06:34 +0000792** If the page contains nBytes of free space but does not contain
drh8b2f49b2001-06-08 00:21:52 +0000793** nBytes of contiguous free space, then this routine automatically
794** calls defragementPage() to consolidate all free space before
795** allocating the new chunk.
drh7e3b0a02001-04-28 16:52:40 +0000796*/
drh9e572e62004-04-23 23:43:10 +0000797static int allocateSpace(MemPage *pPage, int nByte){
drh3aac2dd2004-04-26 14:10:20 +0000798 int addr, pc, hdr;
drh9e572e62004-04-23 23:43:10 +0000799 int size;
drh24cd67e2004-05-10 16:18:47 +0000800 int nFrag;
drh43605152004-05-29 21:46:49 +0000801 int top;
802 int nCell;
803 int cellOffset;
drh9e572e62004-04-23 23:43:10 +0000804 unsigned char *data;
drh43605152004-05-29 21:46:49 +0000805
drh9e572e62004-04-23 23:43:10 +0000806 data = pPage->aData;
drha34b6762004-05-07 13:30:42 +0000807 assert( sqlite3pager_iswriteable(data) );
drh9e572e62004-04-23 23:43:10 +0000808 assert( pPage->pBt );
809 if( nByte<4 ) nByte = 4;
drh43605152004-05-29 21:46:49 +0000810 if( pPage->nFree<nByte || pPage->nOverflow>0 ) return 0;
811 pPage->nFree -= nByte;
drh9e572e62004-04-23 23:43:10 +0000812 hdr = pPage->hdrOffset;
drh43605152004-05-29 21:46:49 +0000813
814 nFrag = data[hdr+7];
815 if( nFrag<60 ){
816 /* Search the freelist looking for a slot big enough to satisfy the
817 ** space request. */
818 addr = hdr+1;
819 while( (pc = get2byte(&data[addr]))>0 ){
820 size = get2byte(&data[pc+2]);
821 if( size>=nByte ){
822 if( size<nByte+4 ){
823 memcpy(&data[addr], &data[pc], 2);
824 data[hdr+7] = nFrag + size - nByte;
825 return pc;
826 }else{
827 put2byte(&data[pc+2], size-nByte);
828 return pc + size - nByte;
829 }
830 }
831 addr = pc;
drh9e572e62004-04-23 23:43:10 +0000832 }
833 }
drh43605152004-05-29 21:46:49 +0000834
835 /* Allocate memory from the gap in between the cell pointer array
836 ** and the cell content area.
837 */
838 top = get2byte(&data[hdr+5]);
839 nCell = get2byte(&data[hdr+3]);
840 cellOffset = pPage->cellOffset;
841 if( nFrag>=60 || cellOffset + 2*nCell > top - nByte ){
drh2e38c322004-09-03 18:38:44 +0000842 if( defragmentPage(pPage) ) return 0;
drh43605152004-05-29 21:46:49 +0000843 top = get2byte(&data[hdr+5]);
drh2af926b2001-05-15 00:39:25 +0000844 }
drh43605152004-05-29 21:46:49 +0000845 top -= nByte;
846 assert( cellOffset + 2*nCell <= top );
847 put2byte(&data[hdr+5], top);
848 return top;
drh7e3b0a02001-04-28 16:52:40 +0000849}
850
851/*
drh9e572e62004-04-23 23:43:10 +0000852** Return a section of the pPage->aData to the freelist.
853** The first byte of the new free block is pPage->aDisk[start]
854** and the size of the block is "size" bytes.
drh306dc212001-05-21 13:45:10 +0000855**
856** Most of the effort here is involved in coalesing adjacent
857** free blocks into a single big free block.
drh7e3b0a02001-04-28 16:52:40 +0000858*/
drh9e572e62004-04-23 23:43:10 +0000859static void freeSpace(MemPage *pPage, int start, int size){
drh43605152004-05-29 21:46:49 +0000860 int addr, pbegin, hdr;
drh9e572e62004-04-23 23:43:10 +0000861 unsigned char *data = pPage->aData;
drh2af926b2001-05-15 00:39:25 +0000862
drh9e572e62004-04-23 23:43:10 +0000863 assert( pPage->pBt!=0 );
drha34b6762004-05-07 13:30:42 +0000864 assert( sqlite3pager_iswriteable(data) );
drh9e572e62004-04-23 23:43:10 +0000865 assert( start>=pPage->hdrOffset+6+(pPage->leaf?0:4) );
danielk1977bc6ada42004-06-30 08:20:16 +0000866 assert( (start + size)<=pPage->pBt->usableSize );
drh9e572e62004-04-23 23:43:10 +0000867 if( size<4 ) size = 4;
868
869 /* Add the space back into the linked list of freeblocks */
drh43605152004-05-29 21:46:49 +0000870 hdr = pPage->hdrOffset;
871 addr = hdr + 1;
drh3aac2dd2004-04-26 14:10:20 +0000872 while( (pbegin = get2byte(&data[addr]))<start && pbegin>0 ){
drhb6f41482004-05-14 01:58:11 +0000873 assert( pbegin<=pPage->pBt->usableSize-4 );
drh3aac2dd2004-04-26 14:10:20 +0000874 assert( pbegin>addr );
875 addr = pbegin;
drh2af926b2001-05-15 00:39:25 +0000876 }
drhb6f41482004-05-14 01:58:11 +0000877 assert( pbegin<=pPage->pBt->usableSize-4 );
drh3aac2dd2004-04-26 14:10:20 +0000878 assert( pbegin>addr || pbegin==0 );
drha34b6762004-05-07 13:30:42 +0000879 put2byte(&data[addr], start);
880 put2byte(&data[start], pbegin);
881 put2byte(&data[start+2], size);
drh2af926b2001-05-15 00:39:25 +0000882 pPage->nFree += size;
drh9e572e62004-04-23 23:43:10 +0000883
884 /* Coalesce adjacent free blocks */
drh3aac2dd2004-04-26 14:10:20 +0000885 addr = pPage->hdrOffset + 1;
886 while( (pbegin = get2byte(&data[addr]))>0 ){
drh9e572e62004-04-23 23:43:10 +0000887 int pnext, psize;
drh3aac2dd2004-04-26 14:10:20 +0000888 assert( pbegin>addr );
drh43605152004-05-29 21:46:49 +0000889 assert( pbegin<=pPage->pBt->usableSize-4 );
drh9e572e62004-04-23 23:43:10 +0000890 pnext = get2byte(&data[pbegin]);
891 psize = get2byte(&data[pbegin+2]);
892 if( pbegin + psize + 3 >= pnext && pnext>0 ){
893 int frag = pnext - (pbegin+psize);
drh43605152004-05-29 21:46:49 +0000894 assert( frag<=data[pPage->hdrOffset+7] );
895 data[pPage->hdrOffset+7] -= frag;
drh9e572e62004-04-23 23:43:10 +0000896 put2byte(&data[pbegin], get2byte(&data[pnext]));
897 put2byte(&data[pbegin+2], pnext+get2byte(&data[pnext+2])-pbegin);
898 }else{
drh3aac2dd2004-04-26 14:10:20 +0000899 addr = pbegin;
drh9e572e62004-04-23 23:43:10 +0000900 }
901 }
drh7e3b0a02001-04-28 16:52:40 +0000902
drh43605152004-05-29 21:46:49 +0000903 /* If the cell content area begins with a freeblock, remove it. */
904 if( data[hdr+1]==data[hdr+5] && data[hdr+2]==data[hdr+6] ){
905 int top;
906 pbegin = get2byte(&data[hdr+1]);
907 memcpy(&data[hdr+1], &data[pbegin], 2);
908 top = get2byte(&data[hdr+5]);
909 put2byte(&data[hdr+5], top + get2byte(&data[pbegin+2]));
drh4b70f112004-05-02 21:12:19 +0000910 }
drh4b70f112004-05-02 21:12:19 +0000911}
912
913/*
drh271efa52004-05-30 19:19:05 +0000914** Decode the flags byte (the first byte of the header) for a page
915** and initialize fields of the MemPage structure accordingly.
916*/
917static void decodeFlags(MemPage *pPage, int flagByte){
918 Btree *pBt; /* A copy of pPage->pBt */
919
920 assert( pPage->hdrOffset==(pPage->pgno==1 ? 100 : 0) );
921 pPage->intKey = (flagByte & (PTF_INTKEY|PTF_LEAFDATA))!=0;
922 pPage->zeroData = (flagByte & PTF_ZERODATA)!=0;
923 pPage->leaf = (flagByte & PTF_LEAF)!=0;
924 pPage->childPtrSize = 4*(pPage->leaf==0);
925 pBt = pPage->pBt;
926 if( flagByte & PTF_LEAFDATA ){
927 pPage->leafData = 1;
928 pPage->maxLocal = pBt->maxLeaf;
929 pPage->minLocal = pBt->minLeaf;
930 }else{
931 pPage->leafData = 0;
932 pPage->maxLocal = pBt->maxLocal;
933 pPage->minLocal = pBt->minLocal;
934 }
935 pPage->hasData = !(pPage->zeroData || (!pPage->leaf && pPage->leafData));
936}
937
938/*
drh7e3b0a02001-04-28 16:52:40 +0000939** Initialize the auxiliary information for a disk block.
drh72f82862001-05-24 21:06:34 +0000940**
drhbd03cae2001-06-02 02:40:57 +0000941** The pParent parameter must be a pointer to the MemPage which
drh9e572e62004-04-23 23:43:10 +0000942** is the parent of the page being initialized. The root of a
943** BTree has no parent and so for that page, pParent==NULL.
drh5e2f8b92001-05-28 00:41:15 +0000944**
drh72f82862001-05-24 21:06:34 +0000945** Return SQLITE_OK on success. If we see that the page does
drhda47d772002-12-02 04:25:19 +0000946** not contain a well-formed database page, then return
drh72f82862001-05-24 21:06:34 +0000947** SQLITE_CORRUPT. Note that a return of SQLITE_OK does not
948** guarantee that the page is well-formed. It only shows that
949** we failed to detect any corruption.
drh7e3b0a02001-04-28 16:52:40 +0000950*/
drh9e572e62004-04-23 23:43:10 +0000951static int initPage(
drh3aac2dd2004-04-26 14:10:20 +0000952 MemPage *pPage, /* The page to be initialized */
drh9e572e62004-04-23 23:43:10 +0000953 MemPage *pParent /* The parent. Might be NULL */
954){
drh271efa52004-05-30 19:19:05 +0000955 int pc; /* Address of a freeblock within pPage->aData[] */
956 int i; /* Loop counter */
957 int hdr; /* Offset to beginning of page header */
958 u8 *data; /* Equal to pPage->aData */
drh2e38c322004-09-03 18:38:44 +0000959 Btree *pBt; /* The main btree structure */
drh271efa52004-05-30 19:19:05 +0000960 int usableSize; /* Amount of usable space on each page */
961 int cellOffset; /* Offset from start of page to first cell pointer */
962 int nFree; /* Number of unused bytes on the page */
963 int top; /* First byte of the cell content area */
drh2af926b2001-05-15 00:39:25 +0000964
drh2e38c322004-09-03 18:38:44 +0000965 pBt = pPage->pBt;
966 assert( pBt!=0 );
967 assert( pParent==0 || pParent->pBt==pBt );
drha34b6762004-05-07 13:30:42 +0000968 assert( pPage->pgno==sqlite3pager_pagenumber(pPage->aData) );
drh887dc4c2004-10-22 16:22:57 +0000969 assert( pPage->aData == &((unsigned char*)pPage)[-pBt->psAligned] );
drhee696e22004-08-30 16:52:17 +0000970 if( pPage->pParent!=pParent && (pPage->pParent!=0 || pPage->isInit) ){
971 /* The parent page should never change unless the file is corrupt */
972 return SQLITE_CORRUPT; /* bkpt-CORRUPT */
973 }
drh10617cd2004-05-14 15:27:27 +0000974 if( pPage->isInit ) return SQLITE_OK;
drhda200cc2004-05-09 11:51:38 +0000975 if( pPage->pParent==0 && pParent!=0 ){
976 pPage->pParent = pParent;
drha34b6762004-05-07 13:30:42 +0000977 sqlite3pager_ref(pParent->aData);
drh5e2f8b92001-05-28 00:41:15 +0000978 }
drhde647132004-05-07 17:57:49 +0000979 hdr = pPage->hdrOffset;
drha34b6762004-05-07 13:30:42 +0000980 data = pPage->aData;
drh271efa52004-05-30 19:19:05 +0000981 decodeFlags(pPage, data[hdr]);
drh43605152004-05-29 21:46:49 +0000982 pPage->nOverflow = 0;
drhc8629a12004-05-08 20:07:40 +0000983 pPage->idxShift = 0;
drh2e38c322004-09-03 18:38:44 +0000984 usableSize = pBt->usableSize;
drh43605152004-05-29 21:46:49 +0000985 pPage->cellOffset = cellOffset = hdr + 12 - 4*pPage->leaf;
986 top = get2byte(&data[hdr+5]);
987 pPage->nCell = get2byte(&data[hdr+3]);
drh2e38c322004-09-03 18:38:44 +0000988 if( pPage->nCell>MX_CELL(pBt) ){
drhee696e22004-08-30 16:52:17 +0000989 /* To many cells for a single page. The page must be corrupt */
990 return SQLITE_CORRUPT; /* bkpt-CORRUPT */
991 }
992 if( pPage->nCell==0 && pParent!=0 && pParent->pgno!=1 ){
993 /* All pages must have at least one cell, except for root pages */
994 return SQLITE_CORRUPT; /* bkpt-CORRUPT */
995 }
drh9e572e62004-04-23 23:43:10 +0000996
997 /* Compute the total free space on the page */
drh9e572e62004-04-23 23:43:10 +0000998 pc = get2byte(&data[hdr+1]);
drh43605152004-05-29 21:46:49 +0000999 nFree = data[hdr+7] + top - (cellOffset + 2*pPage->nCell);
drh3add3672004-05-15 00:29:24 +00001000 i = 0;
drh9e572e62004-04-23 23:43:10 +00001001 while( pc>0 ){
1002 int next, size;
drhee696e22004-08-30 16:52:17 +00001003 if( pc>usableSize-4 ){
1004 /* Free block is off the page */
1005 return SQLITE_CORRUPT; /* bkpt-CORRUPT */
1006 }
1007 if( i++>SQLITE_MAX_PAGE_SIZE/4 ){
1008 /* The free block list forms an infinite loop */
1009 return SQLITE_CORRUPT; /* bkpt-CORRUPT */
1010 }
drh9e572e62004-04-23 23:43:10 +00001011 next = get2byte(&data[pc]);
1012 size = get2byte(&data[pc+2]);
drhee696e22004-08-30 16:52:17 +00001013 if( next>0 && next<=pc+size+3 ){
1014 /* Free blocks must be in accending order */
1015 return SQLITE_CORRUPT; /* bkpt-CORRUPT */
1016 }
drh3add3672004-05-15 00:29:24 +00001017 nFree += size;
drh9e572e62004-04-23 23:43:10 +00001018 pc = next;
1019 }
drh3add3672004-05-15 00:29:24 +00001020 pPage->nFree = nFree;
drhee696e22004-08-30 16:52:17 +00001021 if( nFree>=usableSize ){
1022 /* Free space cannot exceed total page size */
1023 return SQLITE_CORRUPT; /* bkpt-CORRUPT */
1024 }
drh9e572e62004-04-23 23:43:10 +00001025
drhde647132004-05-07 17:57:49 +00001026 pPage->isInit = 1;
drhda200cc2004-05-09 11:51:38 +00001027 pageIntegrity(pPage);
drh9e572e62004-04-23 23:43:10 +00001028 return SQLITE_OK;
drh7e3b0a02001-04-28 16:52:40 +00001029}
1030
1031/*
drh8b2f49b2001-06-08 00:21:52 +00001032** Set up a raw page so that it looks like a database page holding
1033** no entries.
drhbd03cae2001-06-02 02:40:57 +00001034*/
drh9e572e62004-04-23 23:43:10 +00001035static void zeroPage(MemPage *pPage, int flags){
1036 unsigned char *data = pPage->aData;
1037 Btree *pBt = pPage->pBt;
drh3aac2dd2004-04-26 14:10:20 +00001038 int hdr = pPage->hdrOffset;
drh9e572e62004-04-23 23:43:10 +00001039 int first;
1040
drhda200cc2004-05-09 11:51:38 +00001041 assert( sqlite3pager_pagenumber(data)==pPage->pgno );
drh887dc4c2004-10-22 16:22:57 +00001042 assert( &data[pBt->psAligned] == (unsigned char*)pPage );
drha34b6762004-05-07 13:30:42 +00001043 assert( sqlite3pager_iswriteable(data) );
drhb6f41482004-05-14 01:58:11 +00001044 memset(&data[hdr], 0, pBt->usableSize - hdr);
drh9e572e62004-04-23 23:43:10 +00001045 data[hdr] = flags;
drh43605152004-05-29 21:46:49 +00001046 first = hdr + 8 + 4*((flags&PTF_LEAF)==0);
1047 memset(&data[hdr+1], 0, 4);
1048 data[hdr+7] = 0;
1049 put2byte(&data[hdr+5], pBt->usableSize);
drhb6f41482004-05-14 01:58:11 +00001050 pPage->nFree = pBt->usableSize - first;
drh271efa52004-05-30 19:19:05 +00001051 decodeFlags(pPage, flags);
drh9e572e62004-04-23 23:43:10 +00001052 pPage->hdrOffset = hdr;
drh43605152004-05-29 21:46:49 +00001053 pPage->cellOffset = first;
1054 pPage->nOverflow = 0;
drhda200cc2004-05-09 11:51:38 +00001055 pPage->idxShift = 0;
drh43605152004-05-29 21:46:49 +00001056 pPage->nCell = 0;
drhda200cc2004-05-09 11:51:38 +00001057 pPage->isInit = 1;
1058 pageIntegrity(pPage);
drhbd03cae2001-06-02 02:40:57 +00001059}
1060
1061/*
drh3aac2dd2004-04-26 14:10:20 +00001062** Get a page from the pager. Initialize the MemPage.pBt and
1063** MemPage.aData elements if needed.
1064*/
1065static int getPage(Btree *pBt, Pgno pgno, MemPage **ppPage){
1066 int rc;
1067 unsigned char *aData;
1068 MemPage *pPage;
drha34b6762004-05-07 13:30:42 +00001069 rc = sqlite3pager_get(pBt->pPager, pgno, (void**)&aData);
drh3aac2dd2004-04-26 14:10:20 +00001070 if( rc ) return rc;
drh887dc4c2004-10-22 16:22:57 +00001071 pPage = (MemPage*)&aData[pBt->psAligned];
drh3aac2dd2004-04-26 14:10:20 +00001072 pPage->aData = aData;
1073 pPage->pBt = pBt;
1074 pPage->pgno = pgno;
drhde647132004-05-07 17:57:49 +00001075 pPage->hdrOffset = pPage->pgno==1 ? 100 : 0;
drh3aac2dd2004-04-26 14:10:20 +00001076 *ppPage = pPage;
1077 return SQLITE_OK;
1078}
1079
1080/*
drhde647132004-05-07 17:57:49 +00001081** Get a page from the pager and initialize it. This routine
1082** is just a convenience wrapper around separate calls to
1083** getPage() and initPage().
1084*/
1085static int getAndInitPage(
1086 Btree *pBt, /* The database file */
1087 Pgno pgno, /* Number of the page to get */
1088 MemPage **ppPage, /* Write the page pointer here */
1089 MemPage *pParent /* Parent of the page */
1090){
1091 int rc;
drhee696e22004-08-30 16:52:17 +00001092 if( pgno==0 ){
1093 return SQLITE_CORRUPT; /* bkpt-CORRUPT */
1094 }
drhde647132004-05-07 17:57:49 +00001095 rc = getPage(pBt, pgno, ppPage);
drh10617cd2004-05-14 15:27:27 +00001096 if( rc==SQLITE_OK && (*ppPage)->isInit==0 ){
drhde647132004-05-07 17:57:49 +00001097 rc = initPage(*ppPage, pParent);
1098 }
1099 return rc;
1100}
1101
1102/*
drh3aac2dd2004-04-26 14:10:20 +00001103** Release a MemPage. This should be called once for each prior
1104** call to getPage.
1105*/
drh4b70f112004-05-02 21:12:19 +00001106static void releasePage(MemPage *pPage){
drh3aac2dd2004-04-26 14:10:20 +00001107 if( pPage ){
1108 assert( pPage->aData );
1109 assert( pPage->pBt );
drh887dc4c2004-10-22 16:22:57 +00001110 assert( &pPage->aData[pPage->pBt->psAligned]==(unsigned char*)pPage );
drha34b6762004-05-07 13:30:42 +00001111 sqlite3pager_unref(pPage->aData);
drh3aac2dd2004-04-26 14:10:20 +00001112 }
1113}
1114
1115/*
drh72f82862001-05-24 21:06:34 +00001116** This routine is called when the reference count for a page
1117** reaches zero. We need to unref the pParent pointer when that
1118** happens.
1119*/
drhb6f41482004-05-14 01:58:11 +00001120static void pageDestructor(void *pData, int pageSize){
drh887dc4c2004-10-22 16:22:57 +00001121 MemPage *pPage = (MemPage*)&((char*)pData)[FORCE_ALIGNMENT(pageSize)];
drh72f82862001-05-24 21:06:34 +00001122 if( pPage->pParent ){
1123 MemPage *pParent = pPage->pParent;
1124 pPage->pParent = 0;
drha34b6762004-05-07 13:30:42 +00001125 releasePage(pParent);
drh72f82862001-05-24 21:06:34 +00001126 }
drh3aac2dd2004-04-26 14:10:20 +00001127 pPage->isInit = 0;
drh72f82862001-05-24 21:06:34 +00001128}
1129
1130/*
drha6abd042004-06-09 17:37:22 +00001131** During a rollback, when the pager reloads information into the cache
1132** so that the cache is restored to its original state at the start of
1133** the transaction, for each page restored this routine is called.
1134**
1135** This routine needs to reset the extra data section at the end of the
1136** page to agree with the restored data.
1137*/
1138static void pageReinit(void *pData, int pageSize){
drh887dc4c2004-10-22 16:22:57 +00001139 MemPage *pPage = (MemPage*)&((char*)pData)[FORCE_ALIGNMENT(pageSize)];
drha6abd042004-06-09 17:37:22 +00001140 if( pPage->isInit ){
1141 pPage->isInit = 0;
1142 initPage(pPage, pPage->pParent);
1143 }
1144}
1145
1146/*
drhad3e0102004-09-03 23:32:18 +00001147** Open a database file.
1148**
drh382c0242001-10-06 16:33:02 +00001149** zFilename is the name of the database file. If zFilename is NULL
drh1bee3d72001-10-15 00:44:35 +00001150** a new database with a random name is created. This randomly named
drh23e11ca2004-05-04 17:27:28 +00001151** database file will be deleted when sqlite3BtreeClose() is called.
drha059ad02001-04-17 20:09:11 +00001152*/
drh23e11ca2004-05-04 17:27:28 +00001153int sqlite3BtreeOpen(
drh3aac2dd2004-04-26 14:10:20 +00001154 const char *zFilename, /* Name of the file containing the BTree database */
1155 Btree **ppBtree, /* Pointer to new Btree object written here */
drh90f5ecb2004-07-22 01:19:35 +00001156 int flags /* Options */
drh6019e162001-07-02 17:51:45 +00001157){
drha059ad02001-04-17 20:09:11 +00001158 Btree *pBt;
drha34b6762004-05-07 13:30:42 +00001159 int rc;
drh90f5ecb2004-07-22 01:19:35 +00001160 int nReserve;
1161 unsigned char zDbHeader[100];
drha059ad02001-04-17 20:09:11 +00001162
drhd62d3d02003-01-24 12:14:20 +00001163 /*
1164 ** The following asserts make sure that structures used by the btree are
1165 ** the right size. This is to guard against size changes that result
1166 ** when compiling on a different architecture.
1167 */
drh4a1c3802004-05-12 15:15:47 +00001168 assert( sizeof(i64)==8 );
drh9e572e62004-04-23 23:43:10 +00001169 assert( sizeof(u64)==8 );
drhd62d3d02003-01-24 12:14:20 +00001170 assert( sizeof(u32)==4 );
1171 assert( sizeof(u16)==2 );
1172 assert( sizeof(Pgno)==4 );
drhd62d3d02003-01-24 12:14:20 +00001173 assert( sizeof(ptr)==sizeof(char*) );
1174 assert( sizeof(uptr)==sizeof(ptr) );
1175
drha059ad02001-04-17 20:09:11 +00001176 pBt = sqliteMalloc( sizeof(*pBt) );
1177 if( pBt==0 ){
drh8c42ca92001-06-22 19:15:00 +00001178 *ppBtree = 0;
drha059ad02001-04-17 20:09:11 +00001179 return SQLITE_NOMEM;
1180 }
drh90f5ecb2004-07-22 01:19:35 +00001181 rc = sqlite3pager_open(&pBt->pPager, zFilename, EXTRA_SIZE,
1182 (flags & BTREE_OMIT_JOURNAL)==0);
drha059ad02001-04-17 20:09:11 +00001183 if( rc!=SQLITE_OK ){
drha34b6762004-05-07 13:30:42 +00001184 if( pBt->pPager ) sqlite3pager_close(pBt->pPager);
drha059ad02001-04-17 20:09:11 +00001185 sqliteFree(pBt);
1186 *ppBtree = 0;
1187 return rc;
1188 }
drha34b6762004-05-07 13:30:42 +00001189 sqlite3pager_set_destructor(pBt->pPager, pageDestructor);
drha6abd042004-06-09 17:37:22 +00001190 sqlite3pager_set_reiniter(pBt->pPager, pageReinit);
drha059ad02001-04-17 20:09:11 +00001191 pBt->pCursor = 0;
drha34b6762004-05-07 13:30:42 +00001192 pBt->pPage1 = 0;
1193 pBt->readOnly = sqlite3pager_isreadonly(pBt->pPager);
drh90f5ecb2004-07-22 01:19:35 +00001194 sqlite3pager_read_fileheader(pBt->pPager, sizeof(zDbHeader), zDbHeader);
1195 pBt->pageSize = get2byte(&zDbHeader[16]);
1196 if( pBt->pageSize<512 || pBt->pageSize>SQLITE_MAX_PAGE_SIZE ){
1197 pBt->pageSize = SQLITE_DEFAULT_PAGE_SIZE;
1198 pBt->maxEmbedFrac = 64; /* 25% */
1199 pBt->minEmbedFrac = 32; /* 12.5% */
1200 pBt->minLeafFrac = 32; /* 12.5% */
drheee46cf2004-11-06 00:02:48 +00001201#ifndef SQLITE_OMIT_AUTOVACUUM
danielk1977951af802004-11-05 15:45:09 +00001202 if( zFilename && strcmp(zFilename,":memory:") ){
1203 pBt->autoVacuum = SQLITE_DEFAULT_AUTOVACUUM;
1204 }
drheee46cf2004-11-06 00:02:48 +00001205#endif
drh90f5ecb2004-07-22 01:19:35 +00001206 nReserve = 0;
1207 }else{
1208 nReserve = zDbHeader[20];
1209 pBt->maxEmbedFrac = zDbHeader[21];
1210 pBt->minEmbedFrac = zDbHeader[22];
1211 pBt->minLeafFrac = zDbHeader[23];
1212 pBt->pageSizeFixed = 1;
danielk1977951af802004-11-05 15:45:09 +00001213#ifndef SQLITE_OMIT_AUTOVACUUM
1214 pBt->autoVacuum = (get4byte(&zDbHeader[36 + 4*4])?1:0);
1215#endif
drh90f5ecb2004-07-22 01:19:35 +00001216 }
1217 pBt->usableSize = pBt->pageSize - nReserve;
drh887dc4c2004-10-22 16:22:57 +00001218 pBt->psAligned = FORCE_ALIGNMENT(pBt->pageSize);
drh90f5ecb2004-07-22 01:19:35 +00001219 sqlite3pager_set_pagesize(pBt->pPager, pBt->pageSize);
drha059ad02001-04-17 20:09:11 +00001220 *ppBtree = pBt;
1221 return SQLITE_OK;
1222}
1223
1224/*
1225** Close an open database and invalidate all cursors.
1226*/
drh3aac2dd2004-04-26 14:10:20 +00001227int sqlite3BtreeClose(Btree *pBt){
drha059ad02001-04-17 20:09:11 +00001228 while( pBt->pCursor ){
drh3aac2dd2004-04-26 14:10:20 +00001229 sqlite3BtreeCloseCursor(pBt->pCursor);
drha059ad02001-04-17 20:09:11 +00001230 }
drha34b6762004-05-07 13:30:42 +00001231 sqlite3pager_close(pBt->pPager);
drha059ad02001-04-17 20:09:11 +00001232 sqliteFree(pBt);
1233 return SQLITE_OK;
1234}
1235
1236/*
drh90f5ecb2004-07-22 01:19:35 +00001237** Change the busy handler callback function.
1238*/
1239int sqlite3BtreeSetBusyHandler(Btree *pBt, BusyHandler *pHandler){
1240 sqlite3pager_set_busyhandler(pBt->pPager, pHandler);
1241 return SQLITE_OK;
1242}
1243
1244/*
drhda47d772002-12-02 04:25:19 +00001245** Change the limit on the number of pages allowed in the cache.
drhcd61c282002-03-06 22:01:34 +00001246**
1247** The maximum number of cache pages is set to the absolute
1248** value of mxPage. If mxPage is negative, the pager will
1249** operate asynchronously - it will not stop to do fsync()s
1250** to insure data is written to the disk surface before
1251** continuing. Transactions still work if synchronous is off,
1252** and the database cannot be corrupted if this program
1253** crashes. But if the operating system crashes or there is
1254** an abrupt power failure when synchronous is off, the database
1255** could be left in an inconsistent and unrecoverable state.
1256** Synchronous is on by default so database corruption is not
1257** normally a worry.
drhf57b14a2001-09-14 18:54:08 +00001258*/
drh23e11ca2004-05-04 17:27:28 +00001259int sqlite3BtreeSetCacheSize(Btree *pBt, int mxPage){
drha34b6762004-05-07 13:30:42 +00001260 sqlite3pager_set_cachesize(pBt->pPager, mxPage);
drhf57b14a2001-09-14 18:54:08 +00001261 return SQLITE_OK;
1262}
1263
1264/*
drh973b6e32003-02-12 14:09:42 +00001265** Change the way data is synced to disk in order to increase or decrease
1266** how well the database resists damage due to OS crashes and power
1267** failures. Level 1 is the same as asynchronous (no syncs() occur and
1268** there is a high probability of damage) Level 2 is the default. There
1269** is a very low but non-zero probability of damage. Level 3 reduces the
1270** probability of damage to near zero but with a write performance reduction.
1271*/
drh3aac2dd2004-04-26 14:10:20 +00001272int sqlite3BtreeSetSafetyLevel(Btree *pBt, int level){
drha34b6762004-05-07 13:30:42 +00001273 sqlite3pager_set_safety_level(pBt->pPager, level);
drh973b6e32003-02-12 14:09:42 +00001274 return SQLITE_OK;
1275}
1276
1277/*
drh90f5ecb2004-07-22 01:19:35 +00001278** Change the default pages size and the number of reserved bytes per page.
drh06f50212004-11-02 14:24:33 +00001279**
1280** The page size must be a power of 2 between 512 and 65536. If the page
1281** size supplied does not meet this constraint then the page size is not
1282** changed.
1283**
1284** Page sizes are constrained to be a power of two so that the region
1285** of the database file used for locking (beginning at PENDING_BYTE,
1286** the first byte past the 1GB boundary, 0x40000000) needs to occur
1287** at the beginning of a page.
drh90f5ecb2004-07-22 01:19:35 +00001288*/
1289int sqlite3BtreeSetPageSize(Btree *pBt, int pageSize, int nReserve){
1290 if( pBt->pageSizeFixed ){
1291 return SQLITE_READONLY;
1292 }
1293 if( nReserve<0 ){
1294 nReserve = pBt->pageSize - pBt->usableSize;
1295 }
drh06f50212004-11-02 14:24:33 +00001296 if( pageSize>=512 && pageSize<=SQLITE_MAX_PAGE_SIZE &&
1297 ((pageSize-1)&pageSize)==0 ){
drh90f5ecb2004-07-22 01:19:35 +00001298 pBt->pageSize = pageSize;
drh887dc4c2004-10-22 16:22:57 +00001299 pBt->psAligned = FORCE_ALIGNMENT(pageSize);
drh90f5ecb2004-07-22 01:19:35 +00001300 sqlite3pager_set_pagesize(pBt->pPager, pageSize);
1301 }
1302 pBt->usableSize = pBt->pageSize - nReserve;
1303 return SQLITE_OK;
1304}
1305
1306/*
1307** Return the currently defined page size
1308*/
1309int sqlite3BtreeGetPageSize(Btree *pBt){
1310 return pBt->pageSize;
1311}
drh2011d5f2004-07-22 02:40:37 +00001312int sqlite3BtreeGetReserve(Btree *pBt){
1313 return pBt->pageSize - pBt->usableSize;
1314}
drh90f5ecb2004-07-22 01:19:35 +00001315
1316/*
danielk1977951af802004-11-05 15:45:09 +00001317** Change the 'auto-vacuum' property of the database. If the 'autoVacuum'
1318** parameter is non-zero, then auto-vacuum mode is enabled. If zero, it
1319** is disabled. The default value for the auto-vacuum property is
1320** determined by the SQLITE_DEFAULT_AUTOVACUUM macro.
1321*/
1322int sqlite3BtreeSetAutoVacuum(Btree *pBt, int autoVacuum){
1323#ifdef SQLITE_OMIT_AUTOVACUUM
drheee46cf2004-11-06 00:02:48 +00001324 return SQLITE_READONLY;
danielk1977951af802004-11-05 15:45:09 +00001325#else
1326 if( pBt->pageSizeFixed ){
1327 return SQLITE_READONLY;
1328 }
1329 pBt->autoVacuum = (autoVacuum?1:0);
1330 return SQLITE_OK;
1331#endif
1332}
1333
1334/*
1335** Return the value of the 'auto-vacuum' property. If auto-vacuum is
1336** enabled 1 is returned. Otherwise 0.
1337*/
1338int sqlite3BtreeGetAutoVacuum(Btree *pBt){
1339#ifdef SQLITE_OMIT_AUTOVACUUM
1340 return 0;
1341#else
1342 return pBt->autoVacuum;
1343#endif
1344}
1345
1346
1347/*
drha34b6762004-05-07 13:30:42 +00001348** Get a reference to pPage1 of the database file. This will
drh306dc212001-05-21 13:45:10 +00001349** also acquire a readlock on that file.
1350**
1351** SQLITE_OK is returned on success. If the file is not a
1352** well-formed database file, then SQLITE_CORRUPT is returned.
1353** SQLITE_BUSY is returned if the database is locked. SQLITE_NOMEM
1354** is returned if we run out of memory. SQLITE_PROTOCOL is returned
1355** if there is a locking protocol violation.
1356*/
1357static int lockBtree(Btree *pBt){
1358 int rc;
drh3aac2dd2004-04-26 14:10:20 +00001359 MemPage *pPage1;
drha34b6762004-05-07 13:30:42 +00001360 if( pBt->pPage1 ) return SQLITE_OK;
drh3aac2dd2004-04-26 14:10:20 +00001361 rc = getPage(pBt, 1, &pPage1);
drh306dc212001-05-21 13:45:10 +00001362 if( rc!=SQLITE_OK ) return rc;
drh3aac2dd2004-04-26 14:10:20 +00001363
drh306dc212001-05-21 13:45:10 +00001364
1365 /* Do some checking to help insure the file we opened really is
1366 ** a valid database file.
1367 */
drhb6f41482004-05-14 01:58:11 +00001368 rc = SQLITE_NOTADB;
drha34b6762004-05-07 13:30:42 +00001369 if( sqlite3pager_pagecount(pBt->pPager)>0 ){
drhb6f41482004-05-14 01:58:11 +00001370 u8 *page1 = pPage1->aData;
1371 if( memcmp(page1, zMagicHeader, 16)!=0 ){
drh72f82862001-05-24 21:06:34 +00001372 goto page1_init_failed;
drh306dc212001-05-21 13:45:10 +00001373 }
drhb6f41482004-05-14 01:58:11 +00001374 if( page1[18]>1 || page1[19]>1 ){
1375 goto page1_init_failed;
1376 }
1377 pBt->pageSize = get2byte(&page1[16]);
1378 pBt->usableSize = pBt->pageSize - page1[20];
1379 if( pBt->usableSize<500 ){
1380 goto page1_init_failed;
1381 }
drh887dc4c2004-10-22 16:22:57 +00001382 pBt->psAligned = FORCE_ALIGNMENT(pBt->pageSize);
drhb6f41482004-05-14 01:58:11 +00001383 pBt->maxEmbedFrac = page1[21];
1384 pBt->minEmbedFrac = page1[22];
1385 pBt->minLeafFrac = page1[23];
drh306dc212001-05-21 13:45:10 +00001386 }
drhb6f41482004-05-14 01:58:11 +00001387
1388 /* maxLocal is the maximum amount of payload to store locally for
1389 ** a cell. Make sure it is small enough so that at least minFanout
1390 ** cells can will fit on one page. We assume a 10-byte page header.
1391 ** Besides the payload, the cell must store:
drh43605152004-05-29 21:46:49 +00001392 ** 2-byte pointer to the cell
drhb6f41482004-05-14 01:58:11 +00001393 ** 4-byte child pointer
1394 ** 9-byte nKey value
1395 ** 4-byte nData value
1396 ** 4-byte overflow page pointer
drh43605152004-05-29 21:46:49 +00001397 ** So a cell consists of a 2-byte poiner, a header which is as much as
1398 ** 17 bytes long, 0 to N bytes of payload, and an optional 4 byte overflow
1399 ** page pointer.
drhb6f41482004-05-14 01:58:11 +00001400 */
drh43605152004-05-29 21:46:49 +00001401 pBt->maxLocal = (pBt->usableSize-12)*pBt->maxEmbedFrac/255 - 23;
1402 pBt->minLocal = (pBt->usableSize-12)*pBt->minEmbedFrac/255 - 23;
1403 pBt->maxLeaf = pBt->usableSize - 35;
1404 pBt->minLeaf = (pBt->usableSize-12)*pBt->minLeafFrac/255 - 23;
drhb6f41482004-05-14 01:58:11 +00001405 if( pBt->minLocal>pBt->maxLocal || pBt->maxLocal<0 ){
1406 goto page1_init_failed;
1407 }
drh2e38c322004-09-03 18:38:44 +00001408 assert( pBt->maxLeaf + 23 <= MX_CELL_SIZE(pBt) );
drh3aac2dd2004-04-26 14:10:20 +00001409 pBt->pPage1 = pPage1;
drhb6f41482004-05-14 01:58:11 +00001410 return SQLITE_OK;
drh306dc212001-05-21 13:45:10 +00001411
drh72f82862001-05-24 21:06:34 +00001412page1_init_failed:
drh3aac2dd2004-04-26 14:10:20 +00001413 releasePage(pPage1);
1414 pBt->pPage1 = 0;
drh72f82862001-05-24 21:06:34 +00001415 return rc;
drh306dc212001-05-21 13:45:10 +00001416}
1417
1418/*
drhb8ca3072001-12-05 00:21:20 +00001419** If there are no outstanding cursors and we are not in the middle
1420** of a transaction but there is a read lock on the database, then
1421** this routine unrefs the first page of the database file which
1422** has the effect of releasing the read lock.
1423**
1424** If there are any outstanding cursors, this routine is a no-op.
1425**
1426** If there is a transaction in progress, this routine is a no-op.
1427*/
1428static void unlockBtreeIfUnused(Btree *pBt){
danielk1977ee5741e2004-05-31 10:01:34 +00001429 if( pBt->inTrans==TRANS_NONE && pBt->pCursor==0 && pBt->pPage1!=0 ){
drh51c6d962004-06-06 00:42:25 +00001430 if( pBt->pPage1->aData==0 ){
1431 MemPage *pPage = pBt->pPage1;
drh887dc4c2004-10-22 16:22:57 +00001432 pPage->aData = &((char*)pPage)[-pBt->psAligned];
drh51c6d962004-06-06 00:42:25 +00001433 pPage->pBt = pBt;
1434 pPage->pgno = 1;
1435 }
drh3aac2dd2004-04-26 14:10:20 +00001436 releasePage(pBt->pPage1);
1437 pBt->pPage1 = 0;
drh3aac2dd2004-04-26 14:10:20 +00001438 pBt->inStmt = 0;
drhb8ca3072001-12-05 00:21:20 +00001439 }
1440}
1441
1442/*
drh9e572e62004-04-23 23:43:10 +00001443** Create a new database by initializing the first page of the
drh8c42ca92001-06-22 19:15:00 +00001444** file.
drh8b2f49b2001-06-08 00:21:52 +00001445*/
1446static int newDatabase(Btree *pBt){
drh9e572e62004-04-23 23:43:10 +00001447 MemPage *pP1;
1448 unsigned char *data;
drh8c42ca92001-06-22 19:15:00 +00001449 int rc;
drhde647132004-05-07 17:57:49 +00001450 if( sqlite3pager_pagecount(pBt->pPager)>0 ) return SQLITE_OK;
drh3aac2dd2004-04-26 14:10:20 +00001451 pP1 = pBt->pPage1;
drh9e572e62004-04-23 23:43:10 +00001452 assert( pP1!=0 );
1453 data = pP1->aData;
drha34b6762004-05-07 13:30:42 +00001454 rc = sqlite3pager_write(data);
drh8b2f49b2001-06-08 00:21:52 +00001455 if( rc ) return rc;
drh9e572e62004-04-23 23:43:10 +00001456 memcpy(data, zMagicHeader, sizeof(zMagicHeader));
1457 assert( sizeof(zMagicHeader)==16 );
drhb6f41482004-05-14 01:58:11 +00001458 put2byte(&data[16], pBt->pageSize);
drh9e572e62004-04-23 23:43:10 +00001459 data[18] = 1;
1460 data[19] = 1;
drhb6f41482004-05-14 01:58:11 +00001461 data[20] = pBt->pageSize - pBt->usableSize;
1462 data[21] = pBt->maxEmbedFrac;
1463 data[22] = pBt->minEmbedFrac;
1464 data[23] = pBt->minLeafFrac;
1465 memset(&data[24], 0, 100-24);
drhe6c43812004-05-14 12:17:46 +00001466 zeroPage(pP1, PTF_INTKEY|PTF_LEAF|PTF_LEAFDATA );
drhf2a611c2004-09-05 00:33:43 +00001467 pBt->pageSizeFixed = 1;
danielk1977003ba062004-11-04 02:57:33 +00001468#ifndef SQLITE_OMIT_AUTOVACUUM
1469 if( pBt->autoVacuum ){
1470 put4byte(&data[36 + 4*4], 1);
1471 }
1472#endif
drh8b2f49b2001-06-08 00:21:52 +00001473 return SQLITE_OK;
1474}
1475
1476/*
danielk1977ee5741e2004-05-31 10:01:34 +00001477** Attempt to start a new transaction. A write-transaction
drh684917c2004-10-05 02:41:42 +00001478** is started if the second argument is nonzero, otherwise a read-
1479** transaction. If the second argument is 2 or more and exclusive
1480** transaction is started, meaning that no other process is allowed
1481** to access the database. A preexisting transaction may not be
1482** upgrade to exclusive by calling this routine a second time - the
1483** exclusivity flag only works for a new transaction.
drh8b2f49b2001-06-08 00:21:52 +00001484**
danielk1977ee5741e2004-05-31 10:01:34 +00001485** A write-transaction must be started before attempting any
1486** changes to the database. None of the following routines
1487** will work unless a transaction is started first:
drh8b2f49b2001-06-08 00:21:52 +00001488**
drh23e11ca2004-05-04 17:27:28 +00001489** sqlite3BtreeCreateTable()
1490** sqlite3BtreeCreateIndex()
1491** sqlite3BtreeClearTable()
1492** sqlite3BtreeDropTable()
1493** sqlite3BtreeInsert()
1494** sqlite3BtreeDelete()
1495** sqlite3BtreeUpdateMeta()
danielk197713adf8a2004-06-03 16:08:41 +00001496**
1497** If wrflag is true, then nMaster specifies the maximum length of
1498** a master journal file name supplied later via sqlite3BtreeSync().
1499** This is so that appropriate space can be allocated in the journal file
1500** when it is created..
drha059ad02001-04-17 20:09:11 +00001501*/
danielk197740b38dc2004-06-26 08:38:24 +00001502int sqlite3BtreeBeginTrans(Btree *pBt, int wrflag){
danielk1977ee5741e2004-05-31 10:01:34 +00001503 int rc = SQLITE_OK;
1504
1505 /* If the btree is already in a write-transaction, or it
1506 ** is already in a read-transaction and a read-transaction
1507 ** is requested, this is a no-op.
1508 */
1509 if( pBt->inTrans==TRANS_WRITE ||
1510 (pBt->inTrans==TRANS_READ && !wrflag) ){
1511 return SQLITE_OK;
1512 }
1513 if( pBt->readOnly && wrflag ){
1514 return SQLITE_READONLY;
1515 }
1516
drh3aac2dd2004-04-26 14:10:20 +00001517 if( pBt->pPage1==0 ){
drh7e3b0a02001-04-28 16:52:40 +00001518 rc = lockBtree(pBt);
danielk1977ee5741e2004-05-31 10:01:34 +00001519 }
1520
1521 if( rc==SQLITE_OK && wrflag ){
drh684917c2004-10-05 02:41:42 +00001522 rc = sqlite3pager_begin(pBt->pPage1->aData, wrflag>1);
danielk1977ee5741e2004-05-31 10:01:34 +00001523 if( rc==SQLITE_OK ){
1524 rc = newDatabase(pBt);
drh8c42ca92001-06-22 19:15:00 +00001525 }
drha059ad02001-04-17 20:09:11 +00001526 }
danielk1977ee5741e2004-05-31 10:01:34 +00001527
drhf74b8d92002-09-01 23:20:45 +00001528 if( rc==SQLITE_OK ){
danielk1977ee5741e2004-05-31 10:01:34 +00001529 pBt->inTrans = (wrflag?TRANS_WRITE:TRANS_READ);
1530 if( wrflag ) pBt->inStmt = 0;
drhb8ca3072001-12-05 00:21:20 +00001531 }else{
1532 unlockBtreeIfUnused(pBt);
drha059ad02001-04-17 20:09:11 +00001533 }
drhb8ca3072001-12-05 00:21:20 +00001534 return rc;
drha059ad02001-04-17 20:09:11 +00001535}
1536
1537/*
danielk1977687566d2004-11-02 12:56:41 +00001538** The TRACE macro will print high-level status information about the
1539** btree operation when the global variable sqlite3_btree_trace is
1540** enabled.
1541*/
1542#if SQLITE_TEST
1543# define TRACE(X) if( sqlite3_btree_trace )\
1544 { sqlite3DebugPrintf X; fflush(stdout); }
1545#else
1546# define TRACE(X)
1547#endif
1548int sqlite3_btree_trace=0; /* True to enable tracing */
1549
1550#ifndef SQLITE_OMIT_AUTOVACUUM
1551
1552/*
1553** Set the pointer-map entries for all children of page pPage. Also, if
1554** pPage contains cells that point to overflow pages, set the pointer
1555** map entries for the overflow pages as well.
1556*/
1557static int setChildPtrmaps(MemPage *pPage){
1558 int i; /* Counter variable */
1559 int nCell; /* Number of cells in page pPage */
1560 int rc = SQLITE_OK; /* Return code */
1561 Btree *pBt = pPage->pBt;
1562 int isInitOrig = pPage->isInit;
1563 Pgno pgno = pPage->pgno;
1564
1565 initPage(pPage, 0);
1566 nCell = pPage->nCell;
1567
1568 for(i=0; i<nCell; i++){
1569 CellInfo info;
1570 u8 *pCell = findCell(pPage, i);
1571
1572 parseCellPtr(pPage, pCell, &info);
1573 if( info.iOverflow ){
1574 Pgno ovflPgno = get4byte(&pCell[info.iOverflow]);
1575 rc = ptrmapPut(pBt, ovflPgno, PTRMAP_OVERFLOW1, pgno);
1576 if( rc!=SQLITE_OK ) goto set_child_ptrmaps_out;
1577 }
1578 if( !pPage->leaf ){
1579 Pgno childPgno = get4byte(pCell);
1580 rc = ptrmapPut(pBt, childPgno, PTRMAP_BTREE, pgno);
1581 if( rc!=SQLITE_OK ) goto set_child_ptrmaps_out;
1582 }
1583 }
1584
1585 if( !pPage->leaf ){
1586 Pgno childPgno = get4byte(&pPage->aData[pPage->hdrOffset+8]);
1587 rc = ptrmapPut(pBt, childPgno, PTRMAP_BTREE, pgno);
1588 }
1589
1590set_child_ptrmaps_out:
1591 pPage->isInit = isInitOrig;
1592 return rc;
1593}
1594
1595/*
1596** Somewhere on pPage, which is guarenteed to be a btree page, not an overflow
1597** page, is a pointer to page iFrom. Modify this pointer so that it points to
1598** iTo. Parameter eType describes the type of pointer to be modified, as
1599** follows:
1600**
1601** PTRMAP_BTREE: pPage is a btree-page. The pointer points at a child
1602** page of pPage.
1603**
1604** PTRMAP_OVERFLOW1: pPage is a btree-page. The pointer points at an overflow
1605** page pointed to by one of the cells on pPage.
1606**
1607** PTRMAP_OVERFLOW2: pPage is an overflow-page. The pointer points at the next
1608** overflow page in the list.
1609*/
1610static void modifyPagePointer(MemPage *pPage, Pgno iFrom, Pgno iTo, u8 eType){
1611
1612 if( eType==PTRMAP_OVERFLOW2 ){
danielk1977f78fc082004-11-02 14:40:32 +00001613 /* The pointer is always the first 4 bytes of the page in this case. */
danielk1977687566d2004-11-02 12:56:41 +00001614 assert( get4byte(pPage->aData)==iFrom );
danielk1977f78fc082004-11-02 14:40:32 +00001615 put4byte(pPage->aData, iTo);
danielk1977687566d2004-11-02 12:56:41 +00001616 }else{
1617 int isInitOrig = pPage->isInit;
1618 int i;
1619 int nCell;
1620
1621 initPage(pPage, 0);
1622 nCell = pPage->nCell;
1623
danielk1977687566d2004-11-02 12:56:41 +00001624 for(i=0; i<nCell; i++){
1625 u8 *pCell = findCell(pPage, i);
1626 if( eType==PTRMAP_OVERFLOW1 ){
1627 CellInfo info;
1628 parseCellPtr(pPage, pCell, &info);
1629 if( info.iOverflow ){
1630 if( iFrom==get4byte(&pCell[info.iOverflow]) ){
1631 put4byte(&pCell[info.iOverflow], iTo);
1632 break;
1633 }
1634 }
1635 }else{
1636 if( get4byte(pCell)==iFrom ){
1637 put4byte(pCell, iTo);
1638 break;
1639 }
1640 }
1641 }
1642
1643 if( i==nCell ){
1644 assert( eType==PTRMAP_BTREE );
1645 assert( get4byte(&pPage->aData[pPage->hdrOffset+8])==iFrom );
1646 put4byte(&pPage->aData[pPage->hdrOffset+8], iTo);
1647 }
1648
1649 pPage->isInit = isInitOrig;
1650 }
1651}
1652
danielk1977003ba062004-11-04 02:57:33 +00001653
1654static int relocatePage(
1655 Btree *pBt,
1656 MemPage *pDbPage,
1657 u8 eType,
1658 Pgno iPtrPage,
1659 Pgno iFreePage
1660){
1661 MemPage *pPtrPage; /* The page that contains a pointer to pDbPage */
1662 Pgno iDbPage = pDbPage->pgno;
1663 Pager *pPager = pBt->pPager;
1664 int rc;
1665
danielk1977a0bf2652004-11-04 14:30:04 +00001666 assert( eType==PTRMAP_OVERFLOW2 || eType==PTRMAP_OVERFLOW1 ||
1667 eType==PTRMAP_BTREE || eType==PTRMAP_ROOTPAGE );
danielk1977003ba062004-11-04 02:57:33 +00001668
1669 /* Move page iDbPage from it's current location to page number iFreePage */
1670 TRACE(("AUTOVACUUM: Moving %d to free page %d (ptr page %d type %d)\n",
1671 iDbPage, iFreePage, iPtrPage, eType));
1672 rc = sqlite3pager_movepage(pPager, pDbPage->aData, iFreePage);
1673 if( rc!=SQLITE_OK ){
1674 return rc;
1675 }
1676 pDbPage->pgno = iFreePage;
1677
1678 /* If pDbPage was a btree-page, then it may have child pages and/or cells
1679 ** that point to overflow pages. The pointer map entries for all these
1680 ** pages need to be changed.
1681 **
1682 ** If pDbPage is an overflow page, then the first 4 bytes may store a
1683 ** pointer to a subsequent overflow page. If this is the case, then
1684 ** the pointer map needs to be updated for the subsequent overflow page.
1685 */
danielk1977a0bf2652004-11-04 14:30:04 +00001686 if( eType==PTRMAP_BTREE || eType==PTRMAP_ROOTPAGE ){
danielk1977003ba062004-11-04 02:57:33 +00001687 rc = setChildPtrmaps(pDbPage);
1688 if( rc!=SQLITE_OK ){
1689 return rc;
1690 }
1691 }else{
1692 Pgno nextOvfl = get4byte(pDbPage->aData);
1693 if( nextOvfl!=0 ){
1694 assert( nextOvfl<=sqlite3pager_pagecount(pPager) );
1695 rc = ptrmapPut(pBt, nextOvfl, PTRMAP_OVERFLOW2, iFreePage);
1696 if( rc!=SQLITE_OK ){
1697 return rc;
1698 }
1699 }
1700 }
1701
1702 /* Fix the database pointer on page iPtrPage that pointed at iDbPage so
1703 ** that it points at iFreePage. Also fix the pointer map entry for
1704 ** iPtrPage.
1705 */
danielk1977a0bf2652004-11-04 14:30:04 +00001706 if( eType!=PTRMAP_ROOTPAGE ){
1707 rc = getPage(pBt, iPtrPage, &pPtrPage);
1708 if( rc!=SQLITE_OK ){
1709 return rc;
1710 }
1711 rc = sqlite3pager_write(pPtrPage->aData);
1712 if( rc!=SQLITE_OK ){
1713 releasePage(pPtrPage);
1714 return rc;
1715 }
1716 modifyPagePointer(pPtrPage, iDbPage, iFreePage, eType);
1717 rc = ptrmapPut(pBt, iFreePage, eType, iPtrPage);
danielk1977003ba062004-11-04 02:57:33 +00001718 releasePage(pPtrPage);
danielk1977003ba062004-11-04 02:57:33 +00001719 }
danielk1977003ba062004-11-04 02:57:33 +00001720 return rc;
1721}
1722
danielk1977687566d2004-11-02 12:56:41 +00001723/* Forward declaration required by autoVacuumCommit(). */
danielk1977cb1a7eb2004-11-05 12:27:02 +00001724static int allocatePage(Btree *, MemPage **, Pgno *, Pgno, u8);
danielk1977687566d2004-11-02 12:56:41 +00001725
1726/*
1727** This routine is called prior to sqlite3pager_commit when a transaction
1728** is commited for an auto-vacuum database.
1729*/
danielk1977d761c0c2004-11-05 16:37:02 +00001730static int autoVacuumCommit(Btree *pBt, Pgno *nTrunc){
danielk1977687566d2004-11-02 12:56:41 +00001731 Pager *pPager = pBt->pPager;
1732 Pgno nFreeList; /* Number of pages remaining on the free-list. */
danielk1977a19df672004-11-03 11:37:07 +00001733 int nPtrMap; /* Number of pointer-map pages deallocated */
1734 Pgno origSize; /* Pages in the database file */
1735 Pgno finSize; /* Pages in the database file after truncation */
danielk1977687566d2004-11-02 12:56:41 +00001736 int rc; /* Return code */
1737 u8 eType;
danielk1977a19df672004-11-03 11:37:07 +00001738 int pgsz = pBt->pageSize; /* Page size for this database */
danielk1977687566d2004-11-02 12:56:41 +00001739 Pgno iDbPage; /* The database page to move */
danielk1977687566d2004-11-02 12:56:41 +00001740 MemPage *pDbMemPage = 0; /* "" */
1741 Pgno iPtrPage; /* The page that contains a pointer to iDbPage */
danielk1977687566d2004-11-02 12:56:41 +00001742 Pgno iFreePage; /* The free-list page to move iDbPage to */
1743 MemPage *pFreeMemPage = 0; /* "" */
1744
1745#ifndef NDEBUG
1746 int nRef = *sqlite3pager_stats(pPager);
1747#endif
1748
1749 assert( pBt->autoVacuum );
danielk1977a19df672004-11-03 11:37:07 +00001750 assert( 0==PTRMAP_ISPAGE(pgsz, sqlite3pager_pagecount(pPager)) );
danielk1977687566d2004-11-02 12:56:41 +00001751
1752 /* Figure out how many free-pages are in the database. If there are no
1753 ** free pages, then auto-vacuum is a no-op.
1754 */
1755 nFreeList = get4byte(&pBt->pPage1->aData[36]);
danielk1977a19df672004-11-03 11:37:07 +00001756 if( nFreeList==0 ){
danielk1977d761c0c2004-11-05 16:37:02 +00001757 *nTrunc = 0;
danielk1977a19df672004-11-03 11:37:07 +00001758 return SQLITE_OK;
1759 }
danielk1977687566d2004-11-02 12:56:41 +00001760
danielk1977a19df672004-11-03 11:37:07 +00001761 origSize = sqlite3pager_pagecount(pPager);
1762 nPtrMap = (nFreeList-origSize+PTRMAP_PAGENO(pgsz, origSize)+pgsz/5)/(pgsz/5);
1763 finSize = origSize - nFreeList - nPtrMap;
danielk1977599fcba2004-11-08 07:13:13 +00001764 if( origSize>PENDING_BYTE_PAGE(pBt) && finSize<=PENDING_BYTE_PAGE(pBt) ){
1765 finSize--;
1766 if( PTRMAP_ISPAGE(pBt->pageSize, finSize) ){
1767 finSize--;
1768 }
1769 }
danielk1977a19df672004-11-03 11:37:07 +00001770 TRACE(("AUTOVACUUM: Begin (db size %d->%d)\n", origSize, finSize));
danielk1977687566d2004-11-02 12:56:41 +00001771
danielk1977a19df672004-11-03 11:37:07 +00001772 /* Variable 'finSize' will be the size of the file in pages after
danielk1977687566d2004-11-02 12:56:41 +00001773 ** the auto-vacuum has completed (the current file size minus the number
1774 ** of pages on the free list). Loop through the pages that lie beyond
1775 ** this mark, and if they are not already on the free list, move them
danielk1977a19df672004-11-03 11:37:07 +00001776 ** to a free page earlier in the file (somewhere before finSize).
danielk1977687566d2004-11-02 12:56:41 +00001777 */
danielk1977a19df672004-11-03 11:37:07 +00001778 for( iDbPage=finSize+1; iDbPage<=origSize; iDbPage++ ){
danielk1977599fcba2004-11-08 07:13:13 +00001779 /* If iDbPage is a pointer map page, or the pending-byte page, skip it. */
1780 if( PTRMAP_ISPAGE(pgsz, iDbPage) || iDbPage==PENDING_BYTE_PAGE(pBt) ){
1781 continue;
1782 }
1783
danielk1977687566d2004-11-02 12:56:41 +00001784 rc = ptrmapGet(pBt, iDbPage, &eType, &iPtrPage);
1785 if( rc!=SQLITE_OK ) goto autovacuum_out;
1786 assert( eType!=PTRMAP_ROOTPAGE );
1787
danielk1977599fcba2004-11-08 07:13:13 +00001788 /* If iDbPage is free, do not swap it. */
1789 if( eType==PTRMAP_FREEPAGE ){
danielk1977687566d2004-11-02 12:56:41 +00001790 continue;
1791 }
1792 rc = getPage(pBt, iDbPage, &pDbMemPage);
1793 if( rc!=SQLITE_OK ) goto autovacuum_out;
danielk1977687566d2004-11-02 12:56:41 +00001794
1795 /* Find the next page in the free-list that is not already at the end
1796 ** of the file. A page can be pulled off the free list using the
1797 ** allocatePage() routine.
1798 */
1799 do{
1800 if( pFreeMemPage ){
1801 releasePage(pFreeMemPage);
1802 pFreeMemPage = 0;
1803 }
danielk1977cb1a7eb2004-11-05 12:27:02 +00001804 rc = allocatePage(pBt, &pFreeMemPage, &iFreePage, 0, 0);
danielk1977687566d2004-11-02 12:56:41 +00001805 if( rc!=SQLITE_OK ) goto autovacuum_out;
danielk1977a19df672004-11-03 11:37:07 +00001806 assert( iFreePage<=origSize );
1807 }while( iFreePage>finSize );
danielk1977687566d2004-11-02 12:56:41 +00001808 releasePage(pFreeMemPage);
1809 pFreeMemPage = 0;
danielk1977687566d2004-11-02 12:56:41 +00001810
danielk1977003ba062004-11-04 02:57:33 +00001811 rc = relocatePage(pBt, pDbMemPage, eType, iPtrPage, iFreePage);
danielk1977687566d2004-11-02 12:56:41 +00001812 releasePage(pDbMemPage);
danielk1977687566d2004-11-02 12:56:41 +00001813 if( rc!=SQLITE_OK ) goto autovacuum_out;
danielk1977687566d2004-11-02 12:56:41 +00001814 }
1815
1816 /* The entire free-list has been swapped to the end of the file. So
danielk1977a19df672004-11-03 11:37:07 +00001817 ** truncate the database file to finSize pages and consider the
danielk1977687566d2004-11-02 12:56:41 +00001818 ** free-list empty.
1819 */
1820 rc = sqlite3pager_write(pBt->pPage1->aData);
1821 if( rc!=SQLITE_OK ) goto autovacuum_out;
1822 put4byte(&pBt->pPage1->aData[32], 0);
1823 put4byte(&pBt->pPage1->aData[36], 0);
danielk1977687566d2004-11-02 12:56:41 +00001824 if( rc!=SQLITE_OK ) goto autovacuum_out;
danielk1977d761c0c2004-11-05 16:37:02 +00001825 *nTrunc = finSize;
danielk1977687566d2004-11-02 12:56:41 +00001826
1827autovacuum_out:
1828 /* TODO: A goto autovacuum_out; will fail to call releasePage() on
1829 ** outstanding references. Fix.
1830 */
danielk1977687566d2004-11-02 12:56:41 +00001831 assert( nRef==*sqlite3pager_stats(pPager) );
1832 if( rc!=SQLITE_OK ){
1833 sqlite3pager_rollback(pPager);
1834 }
1835 return rc;
1836}
1837#endif
1838
1839/*
drh2aa679f2001-06-25 02:11:07 +00001840** Commit the transaction currently in progress.
drh5e00f6c2001-09-13 13:46:56 +00001841**
1842** This will release the write lock on the database file. If there
1843** are no active cursors, it also releases the read lock.
drha059ad02001-04-17 20:09:11 +00001844*/
drh3aac2dd2004-04-26 14:10:20 +00001845int sqlite3BtreeCommit(Btree *pBt){
danielk1977ee5741e2004-05-31 10:01:34 +00001846 int rc = SQLITE_OK;
1847 if( pBt->inTrans==TRANS_WRITE ){
1848 rc = sqlite3pager_commit(pBt->pPager);
1849 }
1850 pBt->inTrans = TRANS_NONE;
drh3aac2dd2004-04-26 14:10:20 +00001851 pBt->inStmt = 0;
drh5e00f6c2001-09-13 13:46:56 +00001852 unlockBtreeIfUnused(pBt);
drha059ad02001-04-17 20:09:11 +00001853 return rc;
1854}
1855
danielk1977fbcd5852004-06-15 02:44:18 +00001856#ifndef NDEBUG
1857/*
1858** Return the number of write-cursors open on this handle. This is for use
1859** in assert() expressions, so it is only compiled if NDEBUG is not
1860** defined.
1861*/
1862static int countWriteCursors(Btree *pBt){
1863 BtCursor *pCur;
1864 int r = 0;
1865 for(pCur=pBt->pCursor; pCur; pCur=pCur->pNext){
1866 if( pCur->wrFlag ) r++;
1867 }
1868 return r;
1869}
1870#endif
1871
1872#if 0
drha059ad02001-04-17 20:09:11 +00001873/*
drhc39e0002004-05-07 23:50:57 +00001874** Invalidate all cursors
1875*/
1876static void invalidateCursors(Btree *pBt){
1877 BtCursor *pCur;
1878 for(pCur=pBt->pCursor; pCur; pCur=pCur->pNext){
1879 MemPage *pPage = pCur->pPage;
drhda200cc2004-05-09 11:51:38 +00001880 if( pPage /* && !pPage->isInit */ ){
1881 pageIntegrity(pPage);
drhc39e0002004-05-07 23:50:57 +00001882 releasePage(pPage);
1883 pCur->pPage = 0;
1884 pCur->isValid = 0;
1885 pCur->status = SQLITE_ABORT;
1886 }
1887 }
1888}
danielk1977fbcd5852004-06-15 02:44:18 +00001889#endif
drhc39e0002004-05-07 23:50:57 +00001890
drhda200cc2004-05-09 11:51:38 +00001891#ifdef SQLITE_TEST
1892/*
1893** Print debugging information about all cursors to standard output.
1894*/
1895void sqlite3BtreeCursorList(Btree *pBt){
1896 BtCursor *pCur;
1897 for(pCur=pBt->pCursor; pCur; pCur=pCur->pNext){
1898 MemPage *pPage = pCur->pPage;
1899 char *zMode = pCur->wrFlag ? "rw" : "ro";
drhfe63d1c2004-09-08 20:13:04 +00001900 sqlite3DebugPrintf("CURSOR %p rooted at %4d(%s) currently at %d.%d%s\n",
1901 pCur, pCur->pgnoRoot, zMode,
drhda200cc2004-05-09 11:51:38 +00001902 pPage ? pPage->pgno : 0, pCur->idx,
1903 pCur->isValid ? "" : " eof"
1904 );
1905 }
1906}
1907#endif
1908
drhc39e0002004-05-07 23:50:57 +00001909/*
drhecdc7532001-09-23 02:35:53 +00001910** Rollback the transaction in progress. All cursors will be
1911** invalided by this operation. Any attempt to use a cursor
1912** that was open at the beginning of this operation will result
1913** in an error.
drh5e00f6c2001-09-13 13:46:56 +00001914**
1915** This will release the write lock on the database file. If there
1916** are no active cursors, it also releases the read lock.
drha059ad02001-04-17 20:09:11 +00001917*/
drh3aac2dd2004-04-26 14:10:20 +00001918int sqlite3BtreeRollback(Btree *pBt){
danielk1977cfe9a692004-06-16 12:00:29 +00001919 int rc = SQLITE_OK;
drh24cd67e2004-05-10 16:18:47 +00001920 MemPage *pPage1;
danielk1977ee5741e2004-05-31 10:01:34 +00001921 if( pBt->inTrans==TRANS_WRITE ){
drh24cd67e2004-05-10 16:18:47 +00001922 rc = sqlite3pager_rollback(pBt->pPager);
1923 /* The rollback may have destroyed the pPage1->aData value. So
1924 ** call getPage() on page 1 again to make sure pPage1->aData is
1925 ** set correctly. */
1926 if( getPage(pBt, 1, &pPage1)==SQLITE_OK ){
1927 releasePage(pPage1);
1928 }
danielk1977fbcd5852004-06-15 02:44:18 +00001929 assert( countWriteCursors(pBt)==0 );
drh24cd67e2004-05-10 16:18:47 +00001930 }
danielk1977ee5741e2004-05-31 10:01:34 +00001931 pBt->inTrans = TRANS_NONE;
1932 pBt->inStmt = 0;
drh5e00f6c2001-09-13 13:46:56 +00001933 unlockBtreeIfUnused(pBt);
drha059ad02001-04-17 20:09:11 +00001934 return rc;
1935}
1936
1937/*
drhab01f612004-05-22 02:55:23 +00001938** Start a statement subtransaction. The subtransaction can
1939** can be rolled back independently of the main transaction.
1940** You must start a transaction before starting a subtransaction.
1941** The subtransaction is ended automatically if the main transaction
drh663fc632002-02-02 18:49:19 +00001942** commits or rolls back.
1943**
drhab01f612004-05-22 02:55:23 +00001944** Only one subtransaction may be active at a time. It is an error to try
1945** to start a new subtransaction if another subtransaction is already active.
1946**
1947** Statement subtransactions are used around individual SQL statements
1948** that are contained within a BEGIN...COMMIT block. If a constraint
1949** error occurs within the statement, the effect of that one statement
1950** can be rolled back without having to rollback the entire transaction.
drh663fc632002-02-02 18:49:19 +00001951*/
drh3aac2dd2004-04-26 14:10:20 +00001952int sqlite3BtreeBeginStmt(Btree *pBt){
drh663fc632002-02-02 18:49:19 +00001953 int rc;
danielk1977ee5741e2004-05-31 10:01:34 +00001954 if( (pBt->inTrans!=TRANS_WRITE) || pBt->inStmt ){
drhf74b8d92002-09-01 23:20:45 +00001955 return pBt->readOnly ? SQLITE_READONLY : SQLITE_ERROR;
drh0d65dc02002-02-03 00:56:09 +00001956 }
drha34b6762004-05-07 13:30:42 +00001957 rc = pBt->readOnly ? SQLITE_OK : sqlite3pager_stmt_begin(pBt->pPager);
drh3aac2dd2004-04-26 14:10:20 +00001958 pBt->inStmt = 1;
drh663fc632002-02-02 18:49:19 +00001959 return rc;
1960}
1961
1962
1963/*
drhab01f612004-05-22 02:55:23 +00001964** Commit the statment subtransaction currently in progress. If no
1965** subtransaction is active, this is a no-op.
drh663fc632002-02-02 18:49:19 +00001966*/
drh3aac2dd2004-04-26 14:10:20 +00001967int sqlite3BtreeCommitStmt(Btree *pBt){
drh663fc632002-02-02 18:49:19 +00001968 int rc;
drh3aac2dd2004-04-26 14:10:20 +00001969 if( pBt->inStmt && !pBt->readOnly ){
drha34b6762004-05-07 13:30:42 +00001970 rc = sqlite3pager_stmt_commit(pBt->pPager);
drh663fc632002-02-02 18:49:19 +00001971 }else{
1972 rc = SQLITE_OK;
1973 }
drh3aac2dd2004-04-26 14:10:20 +00001974 pBt->inStmt = 0;
drh663fc632002-02-02 18:49:19 +00001975 return rc;
1976}
1977
1978/*
drhab01f612004-05-22 02:55:23 +00001979** Rollback the active statement subtransaction. If no subtransaction
1980** is active this routine is a no-op.
drh663fc632002-02-02 18:49:19 +00001981**
drhab01f612004-05-22 02:55:23 +00001982** All cursors will be invalidated by this operation. Any attempt
drh663fc632002-02-02 18:49:19 +00001983** to use a cursor that was open at the beginning of this operation
1984** will result in an error.
1985*/
drh3aac2dd2004-04-26 14:10:20 +00001986int sqlite3BtreeRollbackStmt(Btree *pBt){
drh663fc632002-02-02 18:49:19 +00001987 int rc;
drh3aac2dd2004-04-26 14:10:20 +00001988 if( pBt->inStmt==0 || pBt->readOnly ) return SQLITE_OK;
drha34b6762004-05-07 13:30:42 +00001989 rc = sqlite3pager_stmt_rollback(pBt->pPager);
danielk1977fbcd5852004-06-15 02:44:18 +00001990 assert( countWriteCursors(pBt)==0 );
drh3aac2dd2004-04-26 14:10:20 +00001991 pBt->inStmt = 0;
drh663fc632002-02-02 18:49:19 +00001992 return rc;
1993}
1994
1995/*
drh3aac2dd2004-04-26 14:10:20 +00001996** Default key comparison function to be used if no comparison function
1997** is specified on the sqlite3BtreeCursor() call.
1998*/
1999static int dfltCompare(
2000 void *NotUsed, /* User data is not used */
2001 int n1, const void *p1, /* First key to compare */
2002 int n2, const void *p2 /* Second key to compare */
2003){
2004 int c;
2005 c = memcmp(p1, p2, n1<n2 ? n1 : n2);
2006 if( c==0 ){
2007 c = n1 - n2;
2008 }
2009 return c;
2010}
2011
2012/*
drh8b2f49b2001-06-08 00:21:52 +00002013** Create a new cursor for the BTree whose root is on the page
2014** iTable. The act of acquiring a cursor gets a read lock on
2015** the database file.
drh1bee3d72001-10-15 00:44:35 +00002016**
2017** If wrFlag==0, then the cursor can only be used for reading.
drhf74b8d92002-09-01 23:20:45 +00002018** If wrFlag==1, then the cursor can be used for reading or for
2019** writing if other conditions for writing are also met. These
2020** are the conditions that must be met in order for writing to
2021** be allowed:
drh6446c4d2001-12-15 14:22:18 +00002022**
drhf74b8d92002-09-01 23:20:45 +00002023** 1: The cursor must have been opened with wrFlag==1
2024**
2025** 2: No other cursors may be open with wrFlag==0 on the same table
2026**
2027** 3: The database must be writable (not on read-only media)
2028**
2029** 4: There must be an active transaction.
2030**
2031** Condition 2 warrants further discussion. If any cursor is opened
2032** on a table with wrFlag==0, that prevents all other cursors from
2033** writing to that table. This is a kind of "read-lock". When a cursor
2034** is opened with wrFlag==0 it is guaranteed that the table will not
2035** change as long as the cursor is open. This allows the cursor to
2036** do a sequential scan of the table without having to worry about
2037** entries being inserted or deleted during the scan. Cursors should
2038** be opened with wrFlag==0 only if this read-lock property is needed.
2039** That is to say, cursors should be opened with wrFlag==0 only if they
drh23e11ca2004-05-04 17:27:28 +00002040** intend to use the sqlite3BtreeNext() system call. All other cursors
drhf74b8d92002-09-01 23:20:45 +00002041** should be opened with wrFlag==1 even if they never really intend
2042** to write.
2043**
drh6446c4d2001-12-15 14:22:18 +00002044** No checking is done to make sure that page iTable really is the
2045** root page of a b-tree. If it is not, then the cursor acquired
2046** will not work correctly.
drh3aac2dd2004-04-26 14:10:20 +00002047**
2048** The comparison function must be logically the same for every cursor
2049** on a particular table. Changing the comparison function will result
2050** in incorrect operations. If the comparison function is NULL, a
2051** default comparison function is used. The comparison function is
2052** always ignored for INTKEY tables.
drha059ad02001-04-17 20:09:11 +00002053*/
drh3aac2dd2004-04-26 14:10:20 +00002054int sqlite3BtreeCursor(
2055 Btree *pBt, /* The btree */
2056 int iTable, /* Root page of table to open */
2057 int wrFlag, /* 1 to write. 0 read-only */
2058 int (*xCmp)(void*,int,const void*,int,const void*), /* Key Comparison func */
2059 void *pArg, /* First arg to xCompare() */
2060 BtCursor **ppCur /* Write new cursor here */
2061){
drha059ad02001-04-17 20:09:11 +00002062 int rc;
drh8dcd7ca2004-08-08 19:43:29 +00002063 BtCursor *pCur;
drhecdc7532001-09-23 02:35:53 +00002064
drh8dcd7ca2004-08-08 19:43:29 +00002065 *ppCur = 0;
2066 if( wrFlag ){
drh8dcd7ca2004-08-08 19:43:29 +00002067 if( pBt->readOnly ){
2068 return SQLITE_READONLY;
2069 }
2070 if( checkReadLocks(pBt, iTable, 0) ){
2071 return SQLITE_LOCKED;
2072 }
drha0c9a112004-03-10 13:42:37 +00002073 }
drh4b70f112004-05-02 21:12:19 +00002074 if( pBt->pPage1==0 ){
drha059ad02001-04-17 20:09:11 +00002075 rc = lockBtree(pBt);
2076 if( rc!=SQLITE_OK ){
drha059ad02001-04-17 20:09:11 +00002077 return rc;
2078 }
2079 }
drheafe05b2004-06-13 00:54:01 +00002080 pCur = sqliteMallocRaw( sizeof(*pCur) );
drha059ad02001-04-17 20:09:11 +00002081 if( pCur==0 ){
drhbd03cae2001-06-02 02:40:57 +00002082 rc = SQLITE_NOMEM;
2083 goto create_cursor_exception;
2084 }
drh8b2f49b2001-06-08 00:21:52 +00002085 pCur->pgnoRoot = (Pgno)iTable;
drh24cd67e2004-05-10 16:18:47 +00002086 if( iTable==1 && sqlite3pager_pagecount(pBt->pPager)==0 ){
2087 rc = SQLITE_EMPTY;
drheafe05b2004-06-13 00:54:01 +00002088 pCur->pPage = 0;
drh24cd67e2004-05-10 16:18:47 +00002089 goto create_cursor_exception;
2090 }
danielk1977369f27e2004-06-15 11:40:04 +00002091 pCur->pPage = 0; /* For exit-handler, in case getAndInitPage() fails. */
drhde647132004-05-07 17:57:49 +00002092 rc = getAndInitPage(pBt, pCur->pgnoRoot, &pCur->pPage, 0);
drhbd03cae2001-06-02 02:40:57 +00002093 if( rc!=SQLITE_OK ){
2094 goto create_cursor_exception;
drha059ad02001-04-17 20:09:11 +00002095 }
drh3aac2dd2004-04-26 14:10:20 +00002096 pCur->xCompare = xCmp ? xCmp : dfltCompare;
2097 pCur->pArg = pArg;
drh14acc042001-06-10 19:56:58 +00002098 pCur->pBt = pBt;
drhecdc7532001-09-23 02:35:53 +00002099 pCur->wrFlag = wrFlag;
drh14acc042001-06-10 19:56:58 +00002100 pCur->idx = 0;
drh59eb6762004-06-13 23:07:04 +00002101 memset(&pCur->info, 0, sizeof(pCur->info));
drha059ad02001-04-17 20:09:11 +00002102 pCur->pNext = pBt->pCursor;
2103 if( pCur->pNext ){
2104 pCur->pNext->pPrev = pCur;
2105 }
drh14acc042001-06-10 19:56:58 +00002106 pCur->pPrev = 0;
drha059ad02001-04-17 20:09:11 +00002107 pBt->pCursor = pCur;
drhc39e0002004-05-07 23:50:57 +00002108 pCur->isValid = 0;
2109 pCur->status = SQLITE_OK;
drh2af926b2001-05-15 00:39:25 +00002110 *ppCur = pCur;
2111 return SQLITE_OK;
drhbd03cae2001-06-02 02:40:57 +00002112
2113create_cursor_exception:
drhbd03cae2001-06-02 02:40:57 +00002114 if( pCur ){
drh3aac2dd2004-04-26 14:10:20 +00002115 releasePage(pCur->pPage);
drhbd03cae2001-06-02 02:40:57 +00002116 sqliteFree(pCur);
2117 }
drh5e00f6c2001-09-13 13:46:56 +00002118 unlockBtreeIfUnused(pBt);
drhbd03cae2001-06-02 02:40:57 +00002119 return rc;
drha059ad02001-04-17 20:09:11 +00002120}
2121
drh7a224de2004-06-02 01:22:02 +00002122#if 0 /* Not Used */
drhd3d39e92004-05-20 22:16:29 +00002123/*
2124** Change the value of the comparison function used by a cursor.
2125*/
danielk1977bf3b7212004-05-18 10:06:24 +00002126void sqlite3BtreeSetCompare(
drhd3d39e92004-05-20 22:16:29 +00002127 BtCursor *pCur, /* The cursor to whose comparison function is changed */
2128 int(*xCmp)(void*,int,const void*,int,const void*), /* New comparison func */
2129 void *pArg /* First argument to xCmp() */
danielk1977bf3b7212004-05-18 10:06:24 +00002130){
2131 pCur->xCompare = xCmp ? xCmp : dfltCompare;
2132 pCur->pArg = pArg;
2133}
drh7a224de2004-06-02 01:22:02 +00002134#endif
danielk1977bf3b7212004-05-18 10:06:24 +00002135
drha059ad02001-04-17 20:09:11 +00002136/*
drh5e00f6c2001-09-13 13:46:56 +00002137** Close a cursor. The read lock on the database file is released
drhbd03cae2001-06-02 02:40:57 +00002138** when the last cursor is closed.
drha059ad02001-04-17 20:09:11 +00002139*/
drh3aac2dd2004-04-26 14:10:20 +00002140int sqlite3BtreeCloseCursor(BtCursor *pCur){
drha059ad02001-04-17 20:09:11 +00002141 Btree *pBt = pCur->pBt;
drha059ad02001-04-17 20:09:11 +00002142 if( pCur->pPrev ){
2143 pCur->pPrev->pNext = pCur->pNext;
2144 }else{
2145 pBt->pCursor = pCur->pNext;
2146 }
2147 if( pCur->pNext ){
2148 pCur->pNext->pPrev = pCur->pPrev;
2149 }
drh3aac2dd2004-04-26 14:10:20 +00002150 releasePage(pCur->pPage);
drh5e00f6c2001-09-13 13:46:56 +00002151 unlockBtreeIfUnused(pBt);
drha059ad02001-04-17 20:09:11 +00002152 sqliteFree(pCur);
drh8c42ca92001-06-22 19:15:00 +00002153 return SQLITE_OK;
drha059ad02001-04-17 20:09:11 +00002154}
2155
drh7e3b0a02001-04-28 16:52:40 +00002156/*
drh5e2f8b92001-05-28 00:41:15 +00002157** Make a temporary cursor by filling in the fields of pTempCur.
2158** The temporary cursor is not on the cursor list for the Btree.
2159*/
drh14acc042001-06-10 19:56:58 +00002160static void getTempCursor(BtCursor *pCur, BtCursor *pTempCur){
drh5e2f8b92001-05-28 00:41:15 +00002161 memcpy(pTempCur, pCur, sizeof(*pCur));
2162 pTempCur->pNext = 0;
2163 pTempCur->pPrev = 0;
drhecdc7532001-09-23 02:35:53 +00002164 if( pTempCur->pPage ){
drha34b6762004-05-07 13:30:42 +00002165 sqlite3pager_ref(pTempCur->pPage->aData);
drhecdc7532001-09-23 02:35:53 +00002166 }
drh5e2f8b92001-05-28 00:41:15 +00002167}
2168
2169/*
drhbd03cae2001-06-02 02:40:57 +00002170** Delete a temporary cursor such as was made by the CreateTemporaryCursor()
drh5e2f8b92001-05-28 00:41:15 +00002171** function above.
2172*/
drh14acc042001-06-10 19:56:58 +00002173static void releaseTempCursor(BtCursor *pCur){
drhecdc7532001-09-23 02:35:53 +00002174 if( pCur->pPage ){
drha34b6762004-05-07 13:30:42 +00002175 sqlite3pager_unref(pCur->pPage->aData);
drhecdc7532001-09-23 02:35:53 +00002176 }
drh5e2f8b92001-05-28 00:41:15 +00002177}
2178
2179/*
drh9188b382004-05-14 21:12:22 +00002180** Make sure the BtCursor.info field of the given cursor is valid.
drhab01f612004-05-22 02:55:23 +00002181** If it is not already valid, call parseCell() to fill it in.
2182**
2183** BtCursor.info is a cache of the information in the current cell.
2184** Using this cache reduces the number of calls to parseCell().
drh9188b382004-05-14 21:12:22 +00002185*/
2186static void getCellInfo(BtCursor *pCur){
drh271efa52004-05-30 19:19:05 +00002187 if( pCur->info.nSize==0 ){
drh3a41a3f2004-05-30 02:14:17 +00002188 parseCell(pCur->pPage, pCur->idx, &pCur->info);
drh9188b382004-05-14 21:12:22 +00002189 }else{
2190#ifndef NDEBUG
2191 CellInfo info;
drh51c6d962004-06-06 00:42:25 +00002192 memset(&info, 0, sizeof(info));
drh3a41a3f2004-05-30 02:14:17 +00002193 parseCell(pCur->pPage, pCur->idx, &info);
drh9188b382004-05-14 21:12:22 +00002194 assert( memcmp(&info, &pCur->info, sizeof(info))==0 );
2195#endif
2196 }
2197}
2198
2199/*
drh3aac2dd2004-04-26 14:10:20 +00002200** Set *pSize to the size of the buffer needed to hold the value of
2201** the key for the current entry. If the cursor is not pointing
2202** to a valid entry, *pSize is set to 0.
2203**
drh4b70f112004-05-02 21:12:19 +00002204** For a table with the INTKEY flag set, this routine returns the key
drh3aac2dd2004-04-26 14:10:20 +00002205** itself, not the number of bytes in the key.
drh7e3b0a02001-04-28 16:52:40 +00002206*/
drh4a1c3802004-05-12 15:15:47 +00002207int sqlite3BtreeKeySize(BtCursor *pCur, i64 *pSize){
drhc39e0002004-05-07 23:50:57 +00002208 if( !pCur->isValid ){
drh72f82862001-05-24 21:06:34 +00002209 *pSize = 0;
2210 }else{
drh9188b382004-05-14 21:12:22 +00002211 getCellInfo(pCur);
2212 *pSize = pCur->info.nKey;
drh72f82862001-05-24 21:06:34 +00002213 }
2214 return SQLITE_OK;
drha059ad02001-04-17 20:09:11 +00002215}
drh2af926b2001-05-15 00:39:25 +00002216
drh72f82862001-05-24 21:06:34 +00002217/*
drh0e1c19e2004-05-11 00:58:56 +00002218** Set *pSize to the number of bytes of data in the entry the
2219** cursor currently points to. Always return SQLITE_OK.
2220** Failure is not possible. If the cursor is not currently
2221** pointing to an entry (which can happen, for example, if
2222** the database is empty) then *pSize is set to 0.
2223*/
2224int sqlite3BtreeDataSize(BtCursor *pCur, u32 *pSize){
drh0e1c19e2004-05-11 00:58:56 +00002225 if( !pCur->isValid ){
danielk197796fc5fe2004-05-13 11:34:16 +00002226 /* Not pointing at a valid entry - set *pSize to 0. */
drh0e1c19e2004-05-11 00:58:56 +00002227 *pSize = 0;
2228 }else{
drh9188b382004-05-14 21:12:22 +00002229 getCellInfo(pCur);
2230 *pSize = pCur->info.nData;
drh0e1c19e2004-05-11 00:58:56 +00002231 }
2232 return SQLITE_OK;
2233}
2234
2235/*
drh72f82862001-05-24 21:06:34 +00002236** Read payload information from the entry that the pCur cursor is
2237** pointing to. Begin reading the payload at "offset" and read
2238** a total of "amt" bytes. Put the result in zBuf.
2239**
2240** This routine does not make a distinction between key and data.
drhab01f612004-05-22 02:55:23 +00002241** It just reads bytes from the payload area. Data might appear
2242** on the main page or be scattered out on multiple overflow pages.
drh72f82862001-05-24 21:06:34 +00002243*/
drh3aac2dd2004-04-26 14:10:20 +00002244static int getPayload(
2245 BtCursor *pCur, /* Cursor pointing to entry to read from */
2246 int offset, /* Begin reading this far into payload */
2247 int amt, /* Read this many bytes */
2248 unsigned char *pBuf, /* Write the bytes into this buffer */
2249 int skipKey /* offset begins at data if this is true */
2250){
2251 unsigned char *aPayload;
drh2af926b2001-05-15 00:39:25 +00002252 Pgno nextPage;
drh8c42ca92001-06-22 19:15:00 +00002253 int rc;
drh3aac2dd2004-04-26 14:10:20 +00002254 MemPage *pPage;
2255 Btree *pBt;
drh6f11bef2004-05-13 01:12:56 +00002256 int ovflSize;
drhfa1a98a2004-05-14 19:08:17 +00002257 u32 nKey;
drh3aac2dd2004-04-26 14:10:20 +00002258
drh72f82862001-05-24 21:06:34 +00002259 assert( pCur!=0 && pCur->pPage!=0 );
drhc39e0002004-05-07 23:50:57 +00002260 assert( pCur->isValid );
drh3aac2dd2004-04-26 14:10:20 +00002261 pBt = pCur->pBt;
2262 pPage = pCur->pPage;
drhda200cc2004-05-09 11:51:38 +00002263 pageIntegrity(pPage);
drh3aac2dd2004-04-26 14:10:20 +00002264 assert( pCur->idx>=0 && pCur->idx<pPage->nCell );
drh9188b382004-05-14 21:12:22 +00002265 getCellInfo(pCur);
drh43605152004-05-29 21:46:49 +00002266 aPayload = pCur->info.pCell;
drhfa1a98a2004-05-14 19:08:17 +00002267 aPayload += pCur->info.nHeader;
drh3aac2dd2004-04-26 14:10:20 +00002268 if( pPage->intKey ){
drhfa1a98a2004-05-14 19:08:17 +00002269 nKey = 0;
2270 }else{
2271 nKey = pCur->info.nKey;
drh3aac2dd2004-04-26 14:10:20 +00002272 }
2273 assert( offset>=0 );
2274 if( skipKey ){
drhfa1a98a2004-05-14 19:08:17 +00002275 offset += nKey;
drh3aac2dd2004-04-26 14:10:20 +00002276 }
drhfa1a98a2004-05-14 19:08:17 +00002277 if( offset+amt > nKey+pCur->info.nData ){
drha34b6762004-05-07 13:30:42 +00002278 return SQLITE_ERROR;
drh3aac2dd2004-04-26 14:10:20 +00002279 }
drhfa1a98a2004-05-14 19:08:17 +00002280 if( offset<pCur->info.nLocal ){
drh2af926b2001-05-15 00:39:25 +00002281 int a = amt;
drhfa1a98a2004-05-14 19:08:17 +00002282 if( a+offset>pCur->info.nLocal ){
2283 a = pCur->info.nLocal - offset;
drh2af926b2001-05-15 00:39:25 +00002284 }
drha34b6762004-05-07 13:30:42 +00002285 memcpy(pBuf, &aPayload[offset], a);
drh2af926b2001-05-15 00:39:25 +00002286 if( a==amt ){
2287 return SQLITE_OK;
2288 }
drh2aa679f2001-06-25 02:11:07 +00002289 offset = 0;
drha34b6762004-05-07 13:30:42 +00002290 pBuf += a;
drh2af926b2001-05-15 00:39:25 +00002291 amt -= a;
drhdd793422001-06-28 01:54:48 +00002292 }else{
drhfa1a98a2004-05-14 19:08:17 +00002293 offset -= pCur->info.nLocal;
drhbd03cae2001-06-02 02:40:57 +00002294 }
danielk1977cfe9a692004-06-16 12:00:29 +00002295 ovflSize = pBt->usableSize - 4;
drhbd03cae2001-06-02 02:40:57 +00002296 if( amt>0 ){
drhfa1a98a2004-05-14 19:08:17 +00002297 nextPage = get4byte(&aPayload[pCur->info.nLocal]);
danielk1977cfe9a692004-06-16 12:00:29 +00002298 while( amt>0 && nextPage ){
2299 rc = sqlite3pager_get(pBt->pPager, nextPage, (void**)&aPayload);
2300 if( rc!=0 ){
2301 return rc;
drh2af926b2001-05-15 00:39:25 +00002302 }
danielk1977cfe9a692004-06-16 12:00:29 +00002303 nextPage = get4byte(aPayload);
2304 if( offset<ovflSize ){
2305 int a = amt;
2306 if( a + offset > ovflSize ){
2307 a = ovflSize - offset;
2308 }
2309 memcpy(pBuf, &aPayload[offset+4], a);
2310 offset = 0;
2311 amt -= a;
2312 pBuf += a;
2313 }else{
2314 offset -= ovflSize;
2315 }
2316 sqlite3pager_unref(aPayload);
drh2af926b2001-05-15 00:39:25 +00002317 }
drh2af926b2001-05-15 00:39:25 +00002318 }
danielk1977cfe9a692004-06-16 12:00:29 +00002319
drha7fcb052001-12-14 15:09:55 +00002320 if( amt>0 ){
drhee696e22004-08-30 16:52:17 +00002321 return SQLITE_CORRUPT; /* bkpt-CORRUPT */
drha7fcb052001-12-14 15:09:55 +00002322 }
2323 return SQLITE_OK;
drh2af926b2001-05-15 00:39:25 +00002324}
2325
drh72f82862001-05-24 21:06:34 +00002326/*
drh3aac2dd2004-04-26 14:10:20 +00002327** Read part of the key associated with cursor pCur. Exactly
drha34b6762004-05-07 13:30:42 +00002328** "amt" bytes will be transfered into pBuf[]. The transfer
drh3aac2dd2004-04-26 14:10:20 +00002329** begins at "offset".
drh8c1238a2003-01-02 14:43:55 +00002330**
drh3aac2dd2004-04-26 14:10:20 +00002331** Return SQLITE_OK on success or an error code if anything goes
2332** wrong. An error is returned if "offset+amt" is larger than
2333** the available payload.
drh72f82862001-05-24 21:06:34 +00002334*/
drha34b6762004-05-07 13:30:42 +00002335int sqlite3BtreeKey(BtCursor *pCur, u32 offset, u32 amt, void *pBuf){
drhc39e0002004-05-07 23:50:57 +00002336 if( pCur->isValid==0 ){
2337 return pCur->status;
drh3aac2dd2004-04-26 14:10:20 +00002338 }
drhc39e0002004-05-07 23:50:57 +00002339 assert( pCur->pPage!=0 );
2340 assert( pCur->pPage->intKey==0 );
2341 assert( pCur->idx>=0 && pCur->idx<pCur->pPage->nCell );
drh3aac2dd2004-04-26 14:10:20 +00002342 return getPayload(pCur, offset, amt, (unsigned char*)pBuf, 0);
2343}
2344
2345/*
drh3aac2dd2004-04-26 14:10:20 +00002346** Read part of the data associated with cursor pCur. Exactly
drha34b6762004-05-07 13:30:42 +00002347** "amt" bytes will be transfered into pBuf[]. The transfer
drh3aac2dd2004-04-26 14:10:20 +00002348** begins at "offset".
2349**
2350** Return SQLITE_OK on success or an error code if anything goes
2351** wrong. An error is returned if "offset+amt" is larger than
2352** the available payload.
drh72f82862001-05-24 21:06:34 +00002353*/
drh3aac2dd2004-04-26 14:10:20 +00002354int sqlite3BtreeData(BtCursor *pCur, u32 offset, u32 amt, void *pBuf){
drhc39e0002004-05-07 23:50:57 +00002355 if( !pCur->isValid ){
2356 return pCur->status ? pCur->status : SQLITE_INTERNAL;
2357 }
drh8c1238a2003-01-02 14:43:55 +00002358 assert( pCur->pPage!=0 );
drhc39e0002004-05-07 23:50:57 +00002359 assert( pCur->idx>=0 && pCur->idx<pCur->pPage->nCell );
drh3aac2dd2004-04-26 14:10:20 +00002360 return getPayload(pCur, offset, amt, pBuf, 1);
drh2af926b2001-05-15 00:39:25 +00002361}
2362
drh72f82862001-05-24 21:06:34 +00002363/*
drh0e1c19e2004-05-11 00:58:56 +00002364** Return a pointer to payload information from the entry that the
2365** pCur cursor is pointing to. The pointer is to the beginning of
2366** the key if skipKey==0 and it points to the beginning of data if
drhe51c44f2004-05-30 20:46:09 +00002367** skipKey==1. The number of bytes of available key/data is written
2368** into *pAmt. If *pAmt==0, then the value returned will not be
2369** a valid pointer.
drh0e1c19e2004-05-11 00:58:56 +00002370**
2371** This routine is an optimization. It is common for the entire key
2372** and data to fit on the local page and for there to be no overflow
2373** pages. When that is so, this routine can be used to access the
2374** key and data without making a copy. If the key and/or data spills
2375** onto overflow pages, then getPayload() must be used to reassembly
2376** the key/data and copy it into a preallocated buffer.
2377**
2378** The pointer returned by this routine looks directly into the cached
2379** page of the database. The data might change or move the next time
2380** any btree routine is called.
2381*/
2382static const unsigned char *fetchPayload(
2383 BtCursor *pCur, /* Cursor pointing to entry to read from */
drhe51c44f2004-05-30 20:46:09 +00002384 int *pAmt, /* Write the number of available bytes here */
drh0e1c19e2004-05-11 00:58:56 +00002385 int skipKey /* read beginning at data if this is true */
2386){
2387 unsigned char *aPayload;
2388 MemPage *pPage;
2389 Btree *pBt;
drhfa1a98a2004-05-14 19:08:17 +00002390 u32 nKey;
2391 int nLocal;
drh0e1c19e2004-05-11 00:58:56 +00002392
2393 assert( pCur!=0 && pCur->pPage!=0 );
2394 assert( pCur->isValid );
2395 pBt = pCur->pBt;
2396 pPage = pCur->pPage;
2397 pageIntegrity(pPage);
2398 assert( pCur->idx>=0 && pCur->idx<pPage->nCell );
drh9188b382004-05-14 21:12:22 +00002399 getCellInfo(pCur);
drh43605152004-05-29 21:46:49 +00002400 aPayload = pCur->info.pCell;
drhfa1a98a2004-05-14 19:08:17 +00002401 aPayload += pCur->info.nHeader;
drh0e1c19e2004-05-11 00:58:56 +00002402 if( pPage->intKey ){
drhfa1a98a2004-05-14 19:08:17 +00002403 nKey = 0;
2404 }else{
2405 nKey = pCur->info.nKey;
drh0e1c19e2004-05-11 00:58:56 +00002406 }
drh0e1c19e2004-05-11 00:58:56 +00002407 if( skipKey ){
drhfa1a98a2004-05-14 19:08:17 +00002408 aPayload += nKey;
2409 nLocal = pCur->info.nLocal - nKey;
drh0e1c19e2004-05-11 00:58:56 +00002410 }else{
drhfa1a98a2004-05-14 19:08:17 +00002411 nLocal = pCur->info.nLocal;
drhe51c44f2004-05-30 20:46:09 +00002412 if( nLocal>nKey ){
2413 nLocal = nKey;
2414 }
drh0e1c19e2004-05-11 00:58:56 +00002415 }
drhe51c44f2004-05-30 20:46:09 +00002416 *pAmt = nLocal;
drh0e1c19e2004-05-11 00:58:56 +00002417 return aPayload;
2418}
2419
2420
2421/*
drhe51c44f2004-05-30 20:46:09 +00002422** For the entry that cursor pCur is point to, return as
2423** many bytes of the key or data as are available on the local
2424** b-tree page. Write the number of available bytes into *pAmt.
drh0e1c19e2004-05-11 00:58:56 +00002425**
2426** The pointer returned is ephemeral. The key/data may move
2427** or be destroyed on the next call to any Btree routine.
2428**
2429** These routines is used to get quick access to key and data
2430** in the common case where no overflow pages are used.
drh0e1c19e2004-05-11 00:58:56 +00002431*/
drhe51c44f2004-05-30 20:46:09 +00002432const void *sqlite3BtreeKeyFetch(BtCursor *pCur, int *pAmt){
2433 return (const void*)fetchPayload(pCur, pAmt, 0);
drh0e1c19e2004-05-11 00:58:56 +00002434}
drhe51c44f2004-05-30 20:46:09 +00002435const void *sqlite3BtreeDataFetch(BtCursor *pCur, int *pAmt){
2436 return (const void*)fetchPayload(pCur, pAmt, 1);
drh0e1c19e2004-05-11 00:58:56 +00002437}
2438
2439
2440/*
drh8178a752003-01-05 21:41:40 +00002441** Move the cursor down to a new child page. The newPgno argument is the
drhab01f612004-05-22 02:55:23 +00002442** page number of the child page to move to.
drh72f82862001-05-24 21:06:34 +00002443*/
drh3aac2dd2004-04-26 14:10:20 +00002444static int moveToChild(BtCursor *pCur, u32 newPgno){
drh72f82862001-05-24 21:06:34 +00002445 int rc;
2446 MemPage *pNewPage;
drh3aac2dd2004-04-26 14:10:20 +00002447 MemPage *pOldPage;
drh0d316a42002-08-11 20:10:47 +00002448 Btree *pBt = pCur->pBt;
drh72f82862001-05-24 21:06:34 +00002449
drhc39e0002004-05-07 23:50:57 +00002450 assert( pCur->isValid );
drhde647132004-05-07 17:57:49 +00002451 rc = getAndInitPage(pBt, newPgno, &pNewPage, pCur->pPage);
drh6019e162001-07-02 17:51:45 +00002452 if( rc ) return rc;
drhda200cc2004-05-09 11:51:38 +00002453 pageIntegrity(pNewPage);
drh428ae8c2003-01-04 16:48:09 +00002454 pNewPage->idxParent = pCur->idx;
drh3aac2dd2004-04-26 14:10:20 +00002455 pOldPage = pCur->pPage;
2456 pOldPage->idxShift = 0;
2457 releasePage(pOldPage);
drh72f82862001-05-24 21:06:34 +00002458 pCur->pPage = pNewPage;
2459 pCur->idx = 0;
drh271efa52004-05-30 19:19:05 +00002460 pCur->info.nSize = 0;
drh4be295b2003-12-16 03:44:47 +00002461 if( pNewPage->nCell<1 ){
drhee696e22004-08-30 16:52:17 +00002462 return SQLITE_CORRUPT; /* bkpt-CORRUPT */
drh4be295b2003-12-16 03:44:47 +00002463 }
drh72f82862001-05-24 21:06:34 +00002464 return SQLITE_OK;
2465}
2466
2467/*
drh8856d6a2004-04-29 14:42:46 +00002468** Return true if the page is the virtual root of its table.
2469**
2470** The virtual root page is the root page for most tables. But
2471** for the table rooted on page 1, sometime the real root page
2472** is empty except for the right-pointer. In such cases the
2473** virtual root page is the page that the right-pointer of page
2474** 1 is pointing to.
2475*/
2476static int isRootPage(MemPage *pPage){
2477 MemPage *pParent = pPage->pParent;
drhda200cc2004-05-09 11:51:38 +00002478 if( pParent==0 ) return 1;
2479 if( pParent->pgno>1 ) return 0;
2480 if( get2byte(&pParent->aData[pParent->hdrOffset+3])==0 ) return 1;
drh8856d6a2004-04-29 14:42:46 +00002481 return 0;
2482}
2483
2484/*
drh5e2f8b92001-05-28 00:41:15 +00002485** Move the cursor up to the parent page.
2486**
2487** pCur->idx is set to the cell index that contains the pointer
2488** to the page we are coming from. If we are coming from the
2489** right-most child page then pCur->idx is set to one more than
drhbd03cae2001-06-02 02:40:57 +00002490** the largest cell index.
drh72f82862001-05-24 21:06:34 +00002491*/
drh8178a752003-01-05 21:41:40 +00002492static void moveToParent(BtCursor *pCur){
drh72f82862001-05-24 21:06:34 +00002493 Pgno oldPgno;
2494 MemPage *pParent;
drh8178a752003-01-05 21:41:40 +00002495 MemPage *pPage;
drh428ae8c2003-01-04 16:48:09 +00002496 int idxParent;
drh3aac2dd2004-04-26 14:10:20 +00002497
drhc39e0002004-05-07 23:50:57 +00002498 assert( pCur->isValid );
drh8178a752003-01-05 21:41:40 +00002499 pPage = pCur->pPage;
2500 assert( pPage!=0 );
drh8856d6a2004-04-29 14:42:46 +00002501 assert( !isRootPage(pPage) );
drhda200cc2004-05-09 11:51:38 +00002502 pageIntegrity(pPage);
drh8178a752003-01-05 21:41:40 +00002503 pParent = pPage->pParent;
2504 assert( pParent!=0 );
drhda200cc2004-05-09 11:51:38 +00002505 pageIntegrity(pParent);
drh8178a752003-01-05 21:41:40 +00002506 idxParent = pPage->idxParent;
drha34b6762004-05-07 13:30:42 +00002507 sqlite3pager_ref(pParent->aData);
drh3aac2dd2004-04-26 14:10:20 +00002508 oldPgno = pPage->pgno;
2509 releasePage(pPage);
drh72f82862001-05-24 21:06:34 +00002510 pCur->pPage = pParent;
drh271efa52004-05-30 19:19:05 +00002511 pCur->info.nSize = 0;
drh428ae8c2003-01-04 16:48:09 +00002512 assert( pParent->idxShift==0 );
drh43605152004-05-29 21:46:49 +00002513 pCur->idx = idxParent;
drh72f82862001-05-24 21:06:34 +00002514}
2515
2516/*
2517** Move the cursor to the root page
2518*/
drh5e2f8b92001-05-28 00:41:15 +00002519static int moveToRoot(BtCursor *pCur){
drh3aac2dd2004-04-26 14:10:20 +00002520 MemPage *pRoot;
drhbd03cae2001-06-02 02:40:57 +00002521 int rc;
drh0d316a42002-08-11 20:10:47 +00002522 Btree *pBt = pCur->pBt;
drhbd03cae2001-06-02 02:40:57 +00002523
drhde647132004-05-07 17:57:49 +00002524 rc = getAndInitPage(pBt, pCur->pgnoRoot, &pRoot, 0);
drhc39e0002004-05-07 23:50:57 +00002525 if( rc ){
2526 pCur->isValid = 0;
2527 return rc;
2528 }
drh3aac2dd2004-04-26 14:10:20 +00002529 releasePage(pCur->pPage);
drhda200cc2004-05-09 11:51:38 +00002530 pageIntegrity(pRoot);
drh3aac2dd2004-04-26 14:10:20 +00002531 pCur->pPage = pRoot;
drh72f82862001-05-24 21:06:34 +00002532 pCur->idx = 0;
drh271efa52004-05-30 19:19:05 +00002533 pCur->info.nSize = 0;
drh8856d6a2004-04-29 14:42:46 +00002534 if( pRoot->nCell==0 && !pRoot->leaf ){
2535 Pgno subpage;
2536 assert( pRoot->pgno==1 );
drh43605152004-05-29 21:46:49 +00002537 subpage = get4byte(&pRoot->aData[pRoot->hdrOffset+8]);
drh8856d6a2004-04-29 14:42:46 +00002538 assert( subpage>0 );
drh3644f082004-05-10 18:45:09 +00002539 pCur->isValid = 1;
drh4b70f112004-05-02 21:12:19 +00002540 rc = moveToChild(pCur, subpage);
drh8856d6a2004-04-29 14:42:46 +00002541 }
drhc39e0002004-05-07 23:50:57 +00002542 pCur->isValid = pCur->pPage->nCell>0;
drh8856d6a2004-04-29 14:42:46 +00002543 return rc;
drh72f82862001-05-24 21:06:34 +00002544}
drh2af926b2001-05-15 00:39:25 +00002545
drh5e2f8b92001-05-28 00:41:15 +00002546/*
2547** Move the cursor down to the left-most leaf entry beneath the
2548** entry to which it is currently pointing.
2549*/
2550static int moveToLeftmost(BtCursor *pCur){
2551 Pgno pgno;
2552 int rc;
drh3aac2dd2004-04-26 14:10:20 +00002553 MemPage *pPage;
drh5e2f8b92001-05-28 00:41:15 +00002554
drhc39e0002004-05-07 23:50:57 +00002555 assert( pCur->isValid );
drh3aac2dd2004-04-26 14:10:20 +00002556 while( !(pPage = pCur->pPage)->leaf ){
drha34b6762004-05-07 13:30:42 +00002557 assert( pCur->idx>=0 && pCur->idx<pPage->nCell );
drh43605152004-05-29 21:46:49 +00002558 pgno = get4byte(findCell(pPage, pCur->idx));
drh8178a752003-01-05 21:41:40 +00002559 rc = moveToChild(pCur, pgno);
drh5e2f8b92001-05-28 00:41:15 +00002560 if( rc ) return rc;
2561 }
2562 return SQLITE_OK;
2563}
2564
drh2dcc9aa2002-12-04 13:40:25 +00002565/*
2566** Move the cursor down to the right-most leaf entry beneath the
2567** page to which it is currently pointing. Notice the difference
2568** between moveToLeftmost() and moveToRightmost(). moveToLeftmost()
2569** finds the left-most entry beneath the *entry* whereas moveToRightmost()
2570** finds the right-most entry beneath the *page*.
2571*/
2572static int moveToRightmost(BtCursor *pCur){
2573 Pgno pgno;
2574 int rc;
drh3aac2dd2004-04-26 14:10:20 +00002575 MemPage *pPage;
drh2dcc9aa2002-12-04 13:40:25 +00002576
drhc39e0002004-05-07 23:50:57 +00002577 assert( pCur->isValid );
drh3aac2dd2004-04-26 14:10:20 +00002578 while( !(pPage = pCur->pPage)->leaf ){
drh43605152004-05-29 21:46:49 +00002579 pgno = get4byte(&pPage->aData[pPage->hdrOffset+8]);
drh3aac2dd2004-04-26 14:10:20 +00002580 pCur->idx = pPage->nCell;
drh8178a752003-01-05 21:41:40 +00002581 rc = moveToChild(pCur, pgno);
drh2dcc9aa2002-12-04 13:40:25 +00002582 if( rc ) return rc;
2583 }
drh3aac2dd2004-04-26 14:10:20 +00002584 pCur->idx = pPage->nCell - 1;
drh271efa52004-05-30 19:19:05 +00002585 pCur->info.nSize = 0;
drh2dcc9aa2002-12-04 13:40:25 +00002586 return SQLITE_OK;
2587}
2588
drh5e00f6c2001-09-13 13:46:56 +00002589/* Move the cursor to the first entry in the table. Return SQLITE_OK
2590** on success. Set *pRes to 0 if the cursor actually points to something
drh77c679c2002-02-19 22:43:58 +00002591** or set *pRes to 1 if the table is empty.
drh5e00f6c2001-09-13 13:46:56 +00002592*/
drh3aac2dd2004-04-26 14:10:20 +00002593int sqlite3BtreeFirst(BtCursor *pCur, int *pRes){
drh5e00f6c2001-09-13 13:46:56 +00002594 int rc;
drhc39e0002004-05-07 23:50:57 +00002595 if( pCur->status ){
2596 return pCur->status;
2597 }
drh5e00f6c2001-09-13 13:46:56 +00002598 rc = moveToRoot(pCur);
2599 if( rc ) return rc;
drhc39e0002004-05-07 23:50:57 +00002600 if( pCur->isValid==0 ){
2601 assert( pCur->pPage->nCell==0 );
drh5e00f6c2001-09-13 13:46:56 +00002602 *pRes = 1;
2603 return SQLITE_OK;
2604 }
drhc39e0002004-05-07 23:50:57 +00002605 assert( pCur->pPage->nCell>0 );
drh5e00f6c2001-09-13 13:46:56 +00002606 *pRes = 0;
2607 rc = moveToLeftmost(pCur);
2608 return rc;
2609}
drh5e2f8b92001-05-28 00:41:15 +00002610
drh9562b552002-02-19 15:00:07 +00002611/* Move the cursor to the last entry in the table. Return SQLITE_OK
2612** on success. Set *pRes to 0 if the cursor actually points to something
drh77c679c2002-02-19 22:43:58 +00002613** or set *pRes to 1 if the table is empty.
drh9562b552002-02-19 15:00:07 +00002614*/
drh3aac2dd2004-04-26 14:10:20 +00002615int sqlite3BtreeLast(BtCursor *pCur, int *pRes){
drh9562b552002-02-19 15:00:07 +00002616 int rc;
drhc39e0002004-05-07 23:50:57 +00002617 if( pCur->status ){
2618 return pCur->status;
2619 }
drh9562b552002-02-19 15:00:07 +00002620 rc = moveToRoot(pCur);
2621 if( rc ) return rc;
drhc39e0002004-05-07 23:50:57 +00002622 if( pCur->isValid==0 ){
2623 assert( pCur->pPage->nCell==0 );
drh9562b552002-02-19 15:00:07 +00002624 *pRes = 1;
2625 return SQLITE_OK;
2626 }
drhc39e0002004-05-07 23:50:57 +00002627 assert( pCur->isValid );
drh9562b552002-02-19 15:00:07 +00002628 *pRes = 0;
drh2dcc9aa2002-12-04 13:40:25 +00002629 rc = moveToRightmost(pCur);
drh9562b552002-02-19 15:00:07 +00002630 return rc;
2631}
2632
drh3aac2dd2004-04-26 14:10:20 +00002633/* Move the cursor so that it points to an entry near pKey/nKey.
drh72f82862001-05-24 21:06:34 +00002634** Return a success code.
2635**
drh3aac2dd2004-04-26 14:10:20 +00002636** For INTKEY tables, only the nKey parameter is used. pKey is
2637** ignored. For other tables, nKey is the number of bytes of data
2638** in nKey. The comparison function specified when the cursor was
2639** created is used to compare keys.
2640**
drh5e2f8b92001-05-28 00:41:15 +00002641** If an exact match is not found, then the cursor is always
drhbd03cae2001-06-02 02:40:57 +00002642** left pointing at a leaf page which would hold the entry if it
drh5e2f8b92001-05-28 00:41:15 +00002643** were present. The cursor might point to an entry that comes
2644** before or after the key.
2645**
drhbd03cae2001-06-02 02:40:57 +00002646** The result of comparing the key with the entry to which the
drhab01f612004-05-22 02:55:23 +00002647** cursor is written to *pRes if pRes!=NULL. The meaning of
drhbd03cae2001-06-02 02:40:57 +00002648** this value is as follows:
2649**
2650** *pRes<0 The cursor is left pointing at an entry that
drh1a844c32002-12-04 22:29:28 +00002651** is smaller than pKey or if the table is empty
2652** and the cursor is therefore left point to nothing.
drhbd03cae2001-06-02 02:40:57 +00002653**
2654** *pRes==0 The cursor is left pointing at an entry that
2655** exactly matches pKey.
2656**
2657** *pRes>0 The cursor is left pointing at an entry that
drh7c717f72001-06-24 20:39:41 +00002658** is larger than pKey.
drha059ad02001-04-17 20:09:11 +00002659*/
drh4a1c3802004-05-12 15:15:47 +00002660int sqlite3BtreeMoveto(BtCursor *pCur, const void *pKey, i64 nKey, int *pRes){
drh72f82862001-05-24 21:06:34 +00002661 int rc;
drhc39e0002004-05-07 23:50:57 +00002662
2663 if( pCur->status ){
2664 return pCur->status;
2665 }
drh5e2f8b92001-05-28 00:41:15 +00002666 rc = moveToRoot(pCur);
drh72f82862001-05-24 21:06:34 +00002667 if( rc ) return rc;
drhc39e0002004-05-07 23:50:57 +00002668 assert( pCur->pPage );
2669 assert( pCur->pPage->isInit );
2670 if( pCur->isValid==0 ){
drhf328bc82004-05-10 23:29:49 +00002671 *pRes = -1;
drhc39e0002004-05-07 23:50:57 +00002672 assert( pCur->pPage->nCell==0 );
2673 return SQLITE_OK;
2674 }
drh72f82862001-05-24 21:06:34 +00002675 for(;;){
2676 int lwr, upr;
2677 Pgno chldPg;
2678 MemPage *pPage = pCur->pPage;
drh1a844c32002-12-04 22:29:28 +00002679 int c = -1; /* pRes return if table is empty must be -1 */
drh72f82862001-05-24 21:06:34 +00002680 lwr = 0;
2681 upr = pPage->nCell-1;
drhda200cc2004-05-09 11:51:38 +00002682 pageIntegrity(pPage);
drh72f82862001-05-24 21:06:34 +00002683 while( lwr<=upr ){
danielk197713adf8a2004-06-03 16:08:41 +00002684 void *pCellKey;
drh4a1c3802004-05-12 15:15:47 +00002685 i64 nCellKey;
drh72f82862001-05-24 21:06:34 +00002686 pCur->idx = (lwr+upr)/2;
drh271efa52004-05-30 19:19:05 +00002687 pCur->info.nSize = 0;
drhde647132004-05-07 17:57:49 +00002688 sqlite3BtreeKeySize(pCur, &nCellKey);
drh3aac2dd2004-04-26 14:10:20 +00002689 if( pPage->intKey ){
2690 if( nCellKey<nKey ){
2691 c = -1;
2692 }else if( nCellKey>nKey ){
2693 c = +1;
2694 }else{
2695 c = 0;
2696 }
drh3aac2dd2004-04-26 14:10:20 +00002697 }else{
drhe51c44f2004-05-30 20:46:09 +00002698 int available;
danielk197713adf8a2004-06-03 16:08:41 +00002699 pCellKey = (void *)fetchPayload(pCur, &available, 0);
drhe51c44f2004-05-30 20:46:09 +00002700 if( available>=nCellKey ){
2701 c = pCur->xCompare(pCur->pArg, nCellKey, pCellKey, nKey, pKey);
2702 }else{
2703 pCellKey = sqliteMallocRaw( nCellKey );
2704 if( pCellKey==0 ) return SQLITE_NOMEM;
danielk197713adf8a2004-06-03 16:08:41 +00002705 rc = sqlite3BtreeKey(pCur, 0, nCellKey, (void *)pCellKey);
drhe51c44f2004-05-30 20:46:09 +00002706 c = pCur->xCompare(pCur->pArg, nCellKey, pCellKey, nKey, pKey);
2707 sqliteFree(pCellKey);
2708 if( rc ) return rc;
2709 }
drh3aac2dd2004-04-26 14:10:20 +00002710 }
drh72f82862001-05-24 21:06:34 +00002711 if( c==0 ){
drh8b18dd42004-05-12 19:18:15 +00002712 if( pPage->leafData && !pPage->leaf ){
drhfc70e6f2004-05-12 21:11:27 +00002713 lwr = pCur->idx;
2714 upr = lwr - 1;
drh8b18dd42004-05-12 19:18:15 +00002715 break;
2716 }else{
drh8b18dd42004-05-12 19:18:15 +00002717 if( pRes ) *pRes = 0;
2718 return SQLITE_OK;
2719 }
drh72f82862001-05-24 21:06:34 +00002720 }
2721 if( c<0 ){
2722 lwr = pCur->idx+1;
2723 }else{
2724 upr = pCur->idx-1;
2725 }
2726 }
2727 assert( lwr==upr+1 );
drh7aa128d2002-06-21 13:09:16 +00002728 assert( pPage->isInit );
drh3aac2dd2004-04-26 14:10:20 +00002729 if( pPage->leaf ){
drha34b6762004-05-07 13:30:42 +00002730 chldPg = 0;
drh3aac2dd2004-04-26 14:10:20 +00002731 }else if( lwr>=pPage->nCell ){
drh43605152004-05-29 21:46:49 +00002732 chldPg = get4byte(&pPage->aData[pPage->hdrOffset+8]);
drh72f82862001-05-24 21:06:34 +00002733 }else{
drh43605152004-05-29 21:46:49 +00002734 chldPg = get4byte(findCell(pPage, lwr));
drh72f82862001-05-24 21:06:34 +00002735 }
2736 if( chldPg==0 ){
drhc39e0002004-05-07 23:50:57 +00002737 assert( pCur->idx>=0 && pCur->idx<pCur->pPage->nCell );
drh72f82862001-05-24 21:06:34 +00002738 if( pRes ) *pRes = c;
2739 return SQLITE_OK;
2740 }
drh428ae8c2003-01-04 16:48:09 +00002741 pCur->idx = lwr;
drh271efa52004-05-30 19:19:05 +00002742 pCur->info.nSize = 0;
drh8178a752003-01-05 21:41:40 +00002743 rc = moveToChild(pCur, chldPg);
drhc39e0002004-05-07 23:50:57 +00002744 if( rc ){
2745 return rc;
2746 }
drh72f82862001-05-24 21:06:34 +00002747 }
drhbd03cae2001-06-02 02:40:57 +00002748 /* NOT REACHED */
drh72f82862001-05-24 21:06:34 +00002749}
2750
2751/*
drhc39e0002004-05-07 23:50:57 +00002752** Return TRUE if the cursor is not pointing at an entry of the table.
2753**
2754** TRUE will be returned after a call to sqlite3BtreeNext() moves
2755** past the last entry in the table or sqlite3BtreePrev() moves past
2756** the first entry. TRUE is also returned if the table is empty.
2757*/
2758int sqlite3BtreeEof(BtCursor *pCur){
2759 return pCur->isValid==0;
2760}
2761
2762/*
drhbd03cae2001-06-02 02:40:57 +00002763** Advance the cursor to the next entry in the database. If
drh8c1238a2003-01-02 14:43:55 +00002764** successful then set *pRes=0. If the cursor
drhbd03cae2001-06-02 02:40:57 +00002765** was already pointing to the last entry in the database before
drh8c1238a2003-01-02 14:43:55 +00002766** this routine was called, then set *pRes=1.
drh72f82862001-05-24 21:06:34 +00002767*/
drh3aac2dd2004-04-26 14:10:20 +00002768int sqlite3BtreeNext(BtCursor *pCur, int *pRes){
drh72f82862001-05-24 21:06:34 +00002769 int rc;
drh8178a752003-01-05 21:41:40 +00002770 MemPage *pPage = pCur->pPage;
drh8b18dd42004-05-12 19:18:15 +00002771
drh8c1238a2003-01-02 14:43:55 +00002772 assert( pRes!=0 );
drhc39e0002004-05-07 23:50:57 +00002773 if( pCur->isValid==0 ){
drh8c1238a2003-01-02 14:43:55 +00002774 *pRes = 1;
drhc39e0002004-05-07 23:50:57 +00002775 return SQLITE_OK;
drhecdc7532001-09-23 02:35:53 +00002776 }
drh8178a752003-01-05 21:41:40 +00002777 assert( pPage->isInit );
drh8178a752003-01-05 21:41:40 +00002778 assert( pCur->idx<pPage->nCell );
drh72f82862001-05-24 21:06:34 +00002779 pCur->idx++;
drh271efa52004-05-30 19:19:05 +00002780 pCur->info.nSize = 0;
drh8178a752003-01-05 21:41:40 +00002781 if( pCur->idx>=pPage->nCell ){
drha34b6762004-05-07 13:30:42 +00002782 if( !pPage->leaf ){
drh43605152004-05-29 21:46:49 +00002783 rc = moveToChild(pCur, get4byte(&pPage->aData[pPage->hdrOffset+8]));
drh5e2f8b92001-05-28 00:41:15 +00002784 if( rc ) return rc;
2785 rc = moveToLeftmost(pCur);
drh8c1238a2003-01-02 14:43:55 +00002786 *pRes = 0;
2787 return rc;
drh72f82862001-05-24 21:06:34 +00002788 }
drh5e2f8b92001-05-28 00:41:15 +00002789 do{
drh8856d6a2004-04-29 14:42:46 +00002790 if( isRootPage(pPage) ){
drh8c1238a2003-01-02 14:43:55 +00002791 *pRes = 1;
drhc39e0002004-05-07 23:50:57 +00002792 pCur->isValid = 0;
drh5e2f8b92001-05-28 00:41:15 +00002793 return SQLITE_OK;
2794 }
drh8178a752003-01-05 21:41:40 +00002795 moveToParent(pCur);
2796 pPage = pCur->pPage;
2797 }while( pCur->idx>=pPage->nCell );
drh8c1238a2003-01-02 14:43:55 +00002798 *pRes = 0;
drh8b18dd42004-05-12 19:18:15 +00002799 if( pPage->leafData ){
2800 rc = sqlite3BtreeNext(pCur, pRes);
2801 }else{
2802 rc = SQLITE_OK;
2803 }
2804 return rc;
drh8178a752003-01-05 21:41:40 +00002805 }
2806 *pRes = 0;
drh3aac2dd2004-04-26 14:10:20 +00002807 if( pPage->leaf ){
drh8178a752003-01-05 21:41:40 +00002808 return SQLITE_OK;
drh72f82862001-05-24 21:06:34 +00002809 }
drh5e2f8b92001-05-28 00:41:15 +00002810 rc = moveToLeftmost(pCur);
drh8c1238a2003-01-02 14:43:55 +00002811 return rc;
drh72f82862001-05-24 21:06:34 +00002812}
2813
drh3b7511c2001-05-26 13:15:44 +00002814/*
drh2dcc9aa2002-12-04 13:40:25 +00002815** Step the cursor to the back to the previous entry in the database. If
drh8178a752003-01-05 21:41:40 +00002816** successful then set *pRes=0. If the cursor
drh2dcc9aa2002-12-04 13:40:25 +00002817** was already pointing to the first entry in the database before
drh8178a752003-01-05 21:41:40 +00002818** this routine was called, then set *pRes=1.
drh2dcc9aa2002-12-04 13:40:25 +00002819*/
drh3aac2dd2004-04-26 14:10:20 +00002820int sqlite3BtreePrevious(BtCursor *pCur, int *pRes){
drh2dcc9aa2002-12-04 13:40:25 +00002821 int rc;
2822 Pgno pgno;
drh8178a752003-01-05 21:41:40 +00002823 MemPage *pPage;
drhc39e0002004-05-07 23:50:57 +00002824 if( pCur->isValid==0 ){
2825 *pRes = 1;
2826 return SQLITE_OK;
2827 }
drh8178a752003-01-05 21:41:40 +00002828 pPage = pCur->pPage;
drh8178a752003-01-05 21:41:40 +00002829 assert( pPage->isInit );
drh2dcc9aa2002-12-04 13:40:25 +00002830 assert( pCur->idx>=0 );
drha34b6762004-05-07 13:30:42 +00002831 if( !pPage->leaf ){
drh43605152004-05-29 21:46:49 +00002832 pgno = get4byte( findCell(pPage, pCur->idx) );
drh8178a752003-01-05 21:41:40 +00002833 rc = moveToChild(pCur, pgno);
drh2dcc9aa2002-12-04 13:40:25 +00002834 if( rc ) return rc;
2835 rc = moveToRightmost(pCur);
2836 }else{
2837 while( pCur->idx==0 ){
drh8856d6a2004-04-29 14:42:46 +00002838 if( isRootPage(pPage) ){
drhc39e0002004-05-07 23:50:57 +00002839 pCur->isValid = 0;
2840 *pRes = 1;
drh2dcc9aa2002-12-04 13:40:25 +00002841 return SQLITE_OK;
2842 }
drh8178a752003-01-05 21:41:40 +00002843 moveToParent(pCur);
2844 pPage = pCur->pPage;
drh2dcc9aa2002-12-04 13:40:25 +00002845 }
2846 pCur->idx--;
drh271efa52004-05-30 19:19:05 +00002847 pCur->info.nSize = 0;
drh8b18dd42004-05-12 19:18:15 +00002848 if( pPage->leafData ){
2849 rc = sqlite3BtreePrevious(pCur, pRes);
2850 }else{
2851 rc = SQLITE_OK;
2852 }
drh2dcc9aa2002-12-04 13:40:25 +00002853 }
drh8178a752003-01-05 21:41:40 +00002854 *pRes = 0;
drh2dcc9aa2002-12-04 13:40:25 +00002855 return rc;
2856}
2857
2858/*
drh3b7511c2001-05-26 13:15:44 +00002859** Allocate a new page from the database file.
2860**
drha34b6762004-05-07 13:30:42 +00002861** The new page is marked as dirty. (In other words, sqlite3pager_write()
drh3b7511c2001-05-26 13:15:44 +00002862** has already been called on the new page.) The new page has also
2863** been referenced and the calling routine is responsible for calling
drha34b6762004-05-07 13:30:42 +00002864** sqlite3pager_unref() on the new page when it is done.
drh3b7511c2001-05-26 13:15:44 +00002865**
2866** SQLITE_OK is returned on success. Any other return value indicates
2867** an error. *ppPage and *pPgno are undefined in the event of an error.
drha34b6762004-05-07 13:30:42 +00002868** Do not invoke sqlite3pager_unref() on *ppPage if an error is returned.
drhbea00b92002-07-08 10:59:50 +00002869**
drh199e3cf2002-07-18 11:01:47 +00002870** If the "nearby" parameter is not 0, then a (feeble) effort is made to
2871** locate a page close to the page number "nearby". This can be used in an
drhbea00b92002-07-08 10:59:50 +00002872** attempt to keep related pages close to each other in the database file,
2873** which in turn can make database access faster.
danielk1977cb1a7eb2004-11-05 12:27:02 +00002874**
2875** If the "exact" parameter is not 0, and the page-number nearby exists
2876** anywhere on the free-list, then it is guarenteed to be returned. This
2877** is only used by auto-vacuum databases when allocating a new table.
drh3b7511c2001-05-26 13:15:44 +00002878*/
danielk1977cb1a7eb2004-11-05 12:27:02 +00002879static int allocatePage(
2880 Btree *pBt,
2881 MemPage **ppPage,
2882 Pgno *pPgno,
2883 Pgno nearby,
2884 u8 exact
2885){
drh3aac2dd2004-04-26 14:10:20 +00002886 MemPage *pPage1;
drh8c42ca92001-06-22 19:15:00 +00002887 int rc;
drh3aac2dd2004-04-26 14:10:20 +00002888 int n; /* Number of pages on the freelist */
2889 int k; /* Number of leaves on the trunk of the freelist */
drh30e58752002-03-02 20:41:57 +00002890
drh3aac2dd2004-04-26 14:10:20 +00002891 pPage1 = pBt->pPage1;
2892 n = get4byte(&pPage1->aData[36]);
2893 if( n>0 ){
drh91025292004-05-03 19:49:32 +00002894 /* There are pages on the freelist. Reuse one of those pages. */
danielk1977cb1a7eb2004-11-05 12:27:02 +00002895 MemPage *pTrunk = 0;
2896 Pgno iTrunk;
2897 MemPage *pPrevTrunk = 0;
2898 u8 searchList = 0; /* If the free-list must be searched for 'nearby' */
2899
2900 /* If the 'exact' parameter was true and a query of the pointer-map
2901 ** shows that the page 'nearby' is somewhere on the free-list, then
2902 ** the entire-list will be searched for that page.
2903 */
2904#ifndef SQLITE_OMIT_AUTOVACUUM
2905 if( exact ){
2906 u8 eType;
2907 assert( nearby>0 );
2908 assert( pBt->autoVacuum );
2909 rc = ptrmapGet(pBt, nearby, &eType, 0);
2910 if( rc ) return rc;
2911 if( eType==PTRMAP_FREEPAGE ){
2912 searchList = 1;
2913 }
2914 *pPgno = nearby;
2915 }
2916#endif
2917
2918 /* Decrement the free-list count by 1. Set iTrunk to the index of the
2919 ** first free-list trunk page. iPrevTrunk is initially 1.
2920 */
drha34b6762004-05-07 13:30:42 +00002921 rc = sqlite3pager_write(pPage1->aData);
drh3b7511c2001-05-26 13:15:44 +00002922 if( rc ) return rc;
drh3aac2dd2004-04-26 14:10:20 +00002923 put4byte(&pPage1->aData[36], n-1);
danielk1977cb1a7eb2004-11-05 12:27:02 +00002924
2925 /* The code within this loop is run only once if the 'searchList' variable
2926 ** is not true. Otherwise, it runs once for each trunk-page on the
2927 ** free-list until the page 'nearby' is located.
2928 */
2929 do {
2930 pPrevTrunk = pTrunk;
2931 if( pPrevTrunk ){
2932 iTrunk = get4byte(&pPrevTrunk->aData[0]);
drhbea00b92002-07-08 10:59:50 +00002933 }else{
danielk1977cb1a7eb2004-11-05 12:27:02 +00002934 iTrunk = get4byte(&pPage1->aData[32]);
drhbea00b92002-07-08 10:59:50 +00002935 }
danielk1977cb1a7eb2004-11-05 12:27:02 +00002936 rc = getPage(pBt, iTrunk, &pTrunk);
2937 if( rc ){
2938 releasePage(pPrevTrunk);
2939 return rc;
2940 }
2941
2942 /* TODO: This should move to after the loop? */
2943 rc = sqlite3pager_write(pTrunk->aData);
2944 if( rc ){
2945 releasePage(pTrunk);
2946 releasePage(pPrevTrunk);
2947 return rc;
2948 }
2949
2950 k = get4byte(&pTrunk->aData[4]);
2951 if( k==0 && !searchList ){
2952 /* The trunk has no leaves and the list is not being searched.
2953 ** So extract the trunk page itself and use it as the newly
2954 ** allocated page */
2955 assert( pPrevTrunk==0 );
2956 *pPgno = iTrunk;
2957 memcpy(&pPage1->aData[32], &pTrunk->aData[0], 4);
2958 *ppPage = pTrunk;
2959 pTrunk = 0;
2960 TRACE(("ALLOCATE: %d trunk - %d free pages left\n", *pPgno, n-1));
2961 }else if( k>pBt->usableSize/4 - 8 ){
2962 /* Value of k is out of range. Database corruption */
drhee696e22004-08-30 16:52:17 +00002963 return SQLITE_CORRUPT; /* bkpt-CORRUPT */
danielk1977cb1a7eb2004-11-05 12:27:02 +00002964#ifndef SQLITE_OMIT_AUTOVACUUM
2965 }else if( searchList && nearby==iTrunk ){
2966 /* The list is being searched and this trunk page is the page
2967 ** to allocate, regardless of whether it has leaves.
2968 */
2969 assert( *pPgno==iTrunk );
2970 *ppPage = pTrunk;
2971 searchList = 0;
2972 if( k==0 ){
2973 if( !pPrevTrunk ){
2974 memcpy(&pPage1->aData[32], &pTrunk->aData[0], 4);
2975 }else{
2976 memcpy(&pPrevTrunk->aData[0], &pTrunk->aData[0], 4);
2977 }
2978 }else{
2979 /* The trunk page is required by the caller but it contains
2980 ** pointers to free-list leaves. The first leaf becomes a trunk
2981 ** page in this case.
2982 */
2983 MemPage *pNewTrunk;
2984 Pgno iNewTrunk = get4byte(&pTrunk->aData[8]);
2985 rc = getPage(pBt, iNewTrunk, &pNewTrunk);
2986 if( rc!=SQLITE_OK ){
2987 releasePage(pTrunk);
2988 releasePage(pPrevTrunk);
2989 return rc;
2990 }
2991 rc = sqlite3pager_write(pNewTrunk->aData);
2992 if( rc!=SQLITE_OK ){
2993 releasePage(pNewTrunk);
2994 releasePage(pTrunk);
2995 releasePage(pPrevTrunk);
2996 return rc;
2997 }
2998 memcpy(&pNewTrunk->aData[0], &pTrunk->aData[0], 4);
2999 put4byte(&pNewTrunk->aData[4], k-1);
3000 memcpy(&pNewTrunk->aData[8], &pTrunk->aData[12], (k-1)*4);
3001 if( !pPrevTrunk ){
3002 put4byte(&pPage1->aData[32], iNewTrunk);
3003 }else{
3004 put4byte(&pPrevTrunk->aData[0], iNewTrunk);
3005 }
3006 releasePage(pNewTrunk);
3007 }
3008 pTrunk = 0;
3009 TRACE(("ALLOCATE: %d trunk - %d free pages left\n", *pPgno, n-1));
3010#endif
3011 }else{
3012 /* Extract a leaf from the trunk */
3013 int closest;
3014 Pgno iPage;
3015 unsigned char *aData = pTrunk->aData;
3016 if( nearby>0 ){
3017 int i, dist;
3018 closest = 0;
3019 dist = get4byte(&aData[8]) - nearby;
3020 if( dist<0 ) dist = -dist;
3021 for(i=1; i<k; i++){
3022 int d2 = get4byte(&aData[8+i*4]) - nearby;
3023 if( d2<0 ) d2 = -d2;
3024 if( d2<dist ){
3025 closest = i;
3026 dist = d2;
3027 }
3028 }
3029 }else{
3030 closest = 0;
3031 }
3032
3033 iPage = get4byte(&aData[8+closest*4]);
3034 if( !searchList || iPage==nearby ){
3035 *pPgno = iPage;
3036 if( *pPgno>sqlite3pager_pagecount(pBt->pPager) ){
3037 /* Free page off the end of the file */
3038 return SQLITE_CORRUPT; /* bkpt-CORRUPT */
3039 }
3040 TRACE(("ALLOCATE: %d was leaf %d of %d on trunk %d"
3041 ": %d more free pages\n",
3042 *pPgno, closest+1, k, pTrunk->pgno, n-1));
3043 if( closest<k-1 ){
3044 memcpy(&aData[8+closest*4], &aData[4+k*4], 4);
3045 }
3046 put4byte(&aData[4], k-1);
3047 rc = getPage(pBt, *pPgno, ppPage);
3048 if( rc==SQLITE_OK ){
3049 sqlite3pager_dont_rollback((*ppPage)->aData);
3050 rc = sqlite3pager_write((*ppPage)->aData);
3051 }
3052 searchList = 0;
3053 }
drhee696e22004-08-30 16:52:17 +00003054 }
danielk1977cb1a7eb2004-11-05 12:27:02 +00003055 releasePage(pPrevTrunk);
3056 }while( searchList );
3057 releasePage(pTrunk);
drh3b7511c2001-05-26 13:15:44 +00003058 }else{
drh3aac2dd2004-04-26 14:10:20 +00003059 /* There are no pages on the freelist, so create a new page at the
3060 ** end of the file */
drha34b6762004-05-07 13:30:42 +00003061 *pPgno = sqlite3pager_pagecount(pBt->pPager) + 1;
danielk1977afcdd022004-10-31 16:25:42 +00003062
3063#ifndef SQLITE_OMIT_AUTOVACUUM
danielk1977a19df672004-11-03 11:37:07 +00003064 if( pBt->autoVacuum && PTRMAP_ISPAGE(pBt->pageSize, *pPgno) ){
danielk1977afcdd022004-10-31 16:25:42 +00003065 /* If *pPgno refers to a pointer-map page, allocate two new pages
3066 ** at the end of the file instead of one. The first allocated page
3067 ** becomes a new pointer-map page, the second is used by the caller.
3068 */
3069 TRACE(("ALLOCATE: %d from end of file (pointer-map page)\n", *pPgno));
danielk1977599fcba2004-11-08 07:13:13 +00003070 assert( *pPgno!=PENDING_BYTE_PAGE(pBt) );
danielk1977afcdd022004-10-31 16:25:42 +00003071 (*pPgno)++;
3072 }
3073#endif
3074
danielk1977599fcba2004-11-08 07:13:13 +00003075 assert( *pPgno!=PENDING_BYTE_PAGE(pBt) );
drh3aac2dd2004-04-26 14:10:20 +00003076 rc = getPage(pBt, *pPgno, ppPage);
drh3b7511c2001-05-26 13:15:44 +00003077 if( rc ) return rc;
drha34b6762004-05-07 13:30:42 +00003078 rc = sqlite3pager_write((*ppPage)->aData);
drh3a4c1412004-05-09 20:40:11 +00003079 TRACE(("ALLOCATE: %d from end of file\n", *pPgno));
drh3b7511c2001-05-26 13:15:44 +00003080 }
danielk1977599fcba2004-11-08 07:13:13 +00003081
3082 assert( *pPgno!=PENDING_BYTE_PAGE(pBt) );
drh3b7511c2001-05-26 13:15:44 +00003083 return rc;
3084}
3085
3086/*
drh3aac2dd2004-04-26 14:10:20 +00003087** Add a page of the database file to the freelist.
drh5e2f8b92001-05-28 00:41:15 +00003088**
drha34b6762004-05-07 13:30:42 +00003089** sqlite3pager_unref() is NOT called for pPage.
drh3b7511c2001-05-26 13:15:44 +00003090*/
drh3aac2dd2004-04-26 14:10:20 +00003091static int freePage(MemPage *pPage){
3092 Btree *pBt = pPage->pBt;
3093 MemPage *pPage1 = pBt->pPage1;
3094 int rc, n, k;
drh8b2f49b2001-06-08 00:21:52 +00003095
drh3aac2dd2004-04-26 14:10:20 +00003096 /* Prepare the page for freeing */
3097 assert( pPage->pgno>1 );
3098 pPage->isInit = 0;
3099 releasePage(pPage->pParent);
3100 pPage->pParent = 0;
3101
drha34b6762004-05-07 13:30:42 +00003102 /* Increment the free page count on pPage1 */
3103 rc = sqlite3pager_write(pPage1->aData);
drh3aac2dd2004-04-26 14:10:20 +00003104 if( rc ) return rc;
3105 n = get4byte(&pPage1->aData[36]);
3106 put4byte(&pPage1->aData[36], n+1);
3107
danielk1977687566d2004-11-02 12:56:41 +00003108#ifndef SQLITE_OMIT_AUTOVACUUM
3109 /* If the database supports auto-vacuum, write an entry in the pointer-map
danielk1977cb1a7eb2004-11-05 12:27:02 +00003110 ** to indicate that the page is free.
danielk1977687566d2004-11-02 12:56:41 +00003111 */
3112 if( pBt->autoVacuum ){
3113 rc = ptrmapPut(pBt, pPage->pgno, PTRMAP_FREEPAGE, 0);
danielk1977a64a0352004-11-05 01:45:13 +00003114 if( rc ) return rc;
danielk1977687566d2004-11-02 12:56:41 +00003115 }
3116#endif
3117
drh3aac2dd2004-04-26 14:10:20 +00003118 if( n==0 ){
3119 /* This is the first free page */
drhda200cc2004-05-09 11:51:38 +00003120 rc = sqlite3pager_write(pPage->aData);
3121 if( rc ) return rc;
drh3aac2dd2004-04-26 14:10:20 +00003122 memset(pPage->aData, 0, 8);
drha34b6762004-05-07 13:30:42 +00003123 put4byte(&pPage1->aData[32], pPage->pgno);
drh3a4c1412004-05-09 20:40:11 +00003124 TRACE(("FREE-PAGE: %d first\n", pPage->pgno));
drh3aac2dd2004-04-26 14:10:20 +00003125 }else{
3126 /* Other free pages already exist. Retrive the first trunk page
3127 ** of the freelist and find out how many leaves it has. */
drha34b6762004-05-07 13:30:42 +00003128 MemPage *pTrunk;
3129 rc = getPage(pBt, get4byte(&pPage1->aData[32]), &pTrunk);
drh3b7511c2001-05-26 13:15:44 +00003130 if( rc ) return rc;
drh3aac2dd2004-04-26 14:10:20 +00003131 k = get4byte(&pTrunk->aData[4]);
drhee696e22004-08-30 16:52:17 +00003132 if( k>=pBt->usableSize/4 - 8 ){
drh3aac2dd2004-04-26 14:10:20 +00003133 /* The trunk is full. Turn the page being freed into a new
3134 ** trunk page with no leaves. */
drha34b6762004-05-07 13:30:42 +00003135 rc = sqlite3pager_write(pPage->aData);
drh3aac2dd2004-04-26 14:10:20 +00003136 if( rc ) return rc;
3137 put4byte(pPage->aData, pTrunk->pgno);
3138 put4byte(&pPage->aData[4], 0);
3139 put4byte(&pPage1->aData[32], pPage->pgno);
drh3a4c1412004-05-09 20:40:11 +00003140 TRACE(("FREE-PAGE: %d new trunk page replacing %d\n",
3141 pPage->pgno, pTrunk->pgno));
drh3aac2dd2004-04-26 14:10:20 +00003142 }else{
3143 /* Add the newly freed page as a leaf on the current trunk */
drha34b6762004-05-07 13:30:42 +00003144 rc = sqlite3pager_write(pTrunk->aData);
drh3aac2dd2004-04-26 14:10:20 +00003145 if( rc ) return rc;
3146 put4byte(&pTrunk->aData[4], k+1);
3147 put4byte(&pTrunk->aData[8+k*4], pPage->pgno);
drha34b6762004-05-07 13:30:42 +00003148 sqlite3pager_dont_write(pBt->pPager, pPage->pgno);
drh3a4c1412004-05-09 20:40:11 +00003149 TRACE(("FREE-PAGE: %d leaf on trunk page %d\n",pPage->pgno,pTrunk->pgno));
drh3aac2dd2004-04-26 14:10:20 +00003150 }
3151 releasePage(pTrunk);
drh3b7511c2001-05-26 13:15:44 +00003152 }
drh3b7511c2001-05-26 13:15:44 +00003153 return rc;
3154}
3155
3156/*
drh3aac2dd2004-04-26 14:10:20 +00003157** Free any overflow pages associated with the given Cell.
drh3b7511c2001-05-26 13:15:44 +00003158*/
drh3aac2dd2004-04-26 14:10:20 +00003159static int clearCell(MemPage *pPage, unsigned char *pCell){
3160 Btree *pBt = pPage->pBt;
drh6f11bef2004-05-13 01:12:56 +00003161 CellInfo info;
drh3aac2dd2004-04-26 14:10:20 +00003162 Pgno ovflPgno;
drh6f11bef2004-05-13 01:12:56 +00003163 int rc;
drh3b7511c2001-05-26 13:15:44 +00003164
drh43605152004-05-29 21:46:49 +00003165 parseCellPtr(pPage, pCell, &info);
drh6f11bef2004-05-13 01:12:56 +00003166 if( info.iOverflow==0 ){
drha34b6762004-05-07 13:30:42 +00003167 return SQLITE_OK; /* No overflow pages. Return without doing anything */
drh3aac2dd2004-04-26 14:10:20 +00003168 }
drh6f11bef2004-05-13 01:12:56 +00003169 ovflPgno = get4byte(&pCell[info.iOverflow]);
drh3aac2dd2004-04-26 14:10:20 +00003170 while( ovflPgno!=0 ){
3171 MemPage *pOvfl;
3172 rc = getPage(pBt, ovflPgno, &pOvfl);
drh3b7511c2001-05-26 13:15:44 +00003173 if( rc ) return rc;
drh3aac2dd2004-04-26 14:10:20 +00003174 ovflPgno = get4byte(pOvfl->aData);
drha34b6762004-05-07 13:30:42 +00003175 rc = freePage(pOvfl);
drhbd03cae2001-06-02 02:40:57 +00003176 if( rc ) return rc;
drha34b6762004-05-07 13:30:42 +00003177 sqlite3pager_unref(pOvfl->aData);
drh3b7511c2001-05-26 13:15:44 +00003178 }
drh5e2f8b92001-05-28 00:41:15 +00003179 return SQLITE_OK;
drh3b7511c2001-05-26 13:15:44 +00003180}
3181
3182/*
drh91025292004-05-03 19:49:32 +00003183** Create the byte sequence used to represent a cell on page pPage
3184** and write that byte sequence into pCell[]. Overflow pages are
3185** allocated and filled in as necessary. The calling procedure
3186** is responsible for making sure sufficient space has been allocated
3187** for pCell[].
3188**
3189** Note that pCell does not necessary need to point to the pPage->aData
3190** area. pCell might point to some temporary storage. The cell will
3191** be constructed in this temporary area then copied into pPage->aData
3192** later.
drh3b7511c2001-05-26 13:15:44 +00003193*/
3194static int fillInCell(
drh3aac2dd2004-04-26 14:10:20 +00003195 MemPage *pPage, /* The page that contains the cell */
drh4b70f112004-05-02 21:12:19 +00003196 unsigned char *pCell, /* Complete text of the cell */
drh4a1c3802004-05-12 15:15:47 +00003197 const void *pKey, i64 nKey, /* The key */
drh4b70f112004-05-02 21:12:19 +00003198 const void *pData,int nData, /* The data */
3199 int *pnSize /* Write cell size here */
drh3b7511c2001-05-26 13:15:44 +00003200){
drh3b7511c2001-05-26 13:15:44 +00003201 int nPayload;
drh8c6fa9b2004-05-26 00:01:53 +00003202 const u8 *pSrc;
drha34b6762004-05-07 13:30:42 +00003203 int nSrc, n, rc;
drh3aac2dd2004-04-26 14:10:20 +00003204 int spaceLeft;
3205 MemPage *pOvfl = 0;
drh9b171272004-05-08 02:03:22 +00003206 MemPage *pToRelease = 0;
drh3aac2dd2004-04-26 14:10:20 +00003207 unsigned char *pPrior;
3208 unsigned char *pPayload;
3209 Btree *pBt = pPage->pBt;
3210 Pgno pgnoOvfl = 0;
drh4b70f112004-05-02 21:12:19 +00003211 int nHeader;
drh6f11bef2004-05-13 01:12:56 +00003212 CellInfo info;
drh3b7511c2001-05-26 13:15:44 +00003213
drh91025292004-05-03 19:49:32 +00003214 /* Fill in the header. */
drh43605152004-05-29 21:46:49 +00003215 nHeader = 0;
drh91025292004-05-03 19:49:32 +00003216 if( !pPage->leaf ){
3217 nHeader += 4;
3218 }
drh8b18dd42004-05-12 19:18:15 +00003219 if( pPage->hasData ){
drh91025292004-05-03 19:49:32 +00003220 nHeader += putVarint(&pCell[nHeader], nData);
drh6f11bef2004-05-13 01:12:56 +00003221 }else{
drh91025292004-05-03 19:49:32 +00003222 nData = 0;
3223 }
drh6f11bef2004-05-13 01:12:56 +00003224 nHeader += putVarint(&pCell[nHeader], *(u64*)&nKey);
drh43605152004-05-29 21:46:49 +00003225 parseCellPtr(pPage, pCell, &info);
drh6f11bef2004-05-13 01:12:56 +00003226 assert( info.nHeader==nHeader );
3227 assert( info.nKey==nKey );
3228 assert( info.nData==nData );
3229
3230 /* Fill in the payload */
drh3aac2dd2004-04-26 14:10:20 +00003231 nPayload = nData;
3232 if( pPage->intKey ){
3233 pSrc = pData;
3234 nSrc = nData;
drh91025292004-05-03 19:49:32 +00003235 nData = 0;
drh3aac2dd2004-04-26 14:10:20 +00003236 }else{
3237 nPayload += nKey;
3238 pSrc = pKey;
3239 nSrc = nKey;
3240 }
drh6f11bef2004-05-13 01:12:56 +00003241 *pnSize = info.nSize;
3242 spaceLeft = info.nLocal;
drh3aac2dd2004-04-26 14:10:20 +00003243 pPayload = &pCell[nHeader];
drh6f11bef2004-05-13 01:12:56 +00003244 pPrior = &pCell[info.iOverflow];
drh3b7511c2001-05-26 13:15:44 +00003245
drh3b7511c2001-05-26 13:15:44 +00003246 while( nPayload>0 ){
3247 if( spaceLeft==0 ){
danielk1977afcdd022004-10-31 16:25:42 +00003248#ifndef SQLITE_OMIT_AUTOVACUUM
3249 Pgno pgnoPtrmap = pgnoOvfl; /* Overflow page pointer-map entry page */
3250#endif
danielk1977cb1a7eb2004-11-05 12:27:02 +00003251 rc = allocatePage(pBt, &pOvfl, &pgnoOvfl, pgnoOvfl, 0);
danielk1977afcdd022004-10-31 16:25:42 +00003252#ifndef SQLITE_OMIT_AUTOVACUUM
danielk1977a19df672004-11-03 11:37:07 +00003253 /* If the database supports auto-vacuum, and the second or subsequent
3254 ** overflow page is being allocated, add an entry to the pointer-map
3255 ** for that page now. The entry for the first overflow page will be
3256 ** added later, by the insertCell() routine.
danielk1977afcdd022004-10-31 16:25:42 +00003257 */
danielk1977a19df672004-11-03 11:37:07 +00003258 if( pBt->autoVacuum && pgnoPtrmap!=0 && rc==SQLITE_OK ){
3259 rc = ptrmapPut(pBt, pgnoOvfl, PTRMAP_OVERFLOW2, pgnoPtrmap);
danielk1977afcdd022004-10-31 16:25:42 +00003260 }
3261#endif
drh3b7511c2001-05-26 13:15:44 +00003262 if( rc ){
drh9b171272004-05-08 02:03:22 +00003263 releasePage(pToRelease);
drh3aac2dd2004-04-26 14:10:20 +00003264 clearCell(pPage, pCell);
drh3b7511c2001-05-26 13:15:44 +00003265 return rc;
3266 }
drh3aac2dd2004-04-26 14:10:20 +00003267 put4byte(pPrior, pgnoOvfl);
drh9b171272004-05-08 02:03:22 +00003268 releasePage(pToRelease);
3269 pToRelease = pOvfl;
drh3aac2dd2004-04-26 14:10:20 +00003270 pPrior = pOvfl->aData;
3271 put4byte(pPrior, 0);
3272 pPayload = &pOvfl->aData[4];
drhb6f41482004-05-14 01:58:11 +00003273 spaceLeft = pBt->usableSize - 4;
drh3b7511c2001-05-26 13:15:44 +00003274 }
3275 n = nPayload;
3276 if( n>spaceLeft ) n = spaceLeft;
drh3aac2dd2004-04-26 14:10:20 +00003277 if( n>nSrc ) n = nSrc;
3278 memcpy(pPayload, pSrc, n);
drh3b7511c2001-05-26 13:15:44 +00003279 nPayload -= n;
drhde647132004-05-07 17:57:49 +00003280 pPayload += n;
drh9b171272004-05-08 02:03:22 +00003281 pSrc += n;
drh3aac2dd2004-04-26 14:10:20 +00003282 nSrc -= n;
drh3b7511c2001-05-26 13:15:44 +00003283 spaceLeft -= n;
drh3aac2dd2004-04-26 14:10:20 +00003284 if( nSrc==0 ){
3285 nSrc = nData;
3286 pSrc = pData;
3287 }
drhdd793422001-06-28 01:54:48 +00003288 }
drh9b171272004-05-08 02:03:22 +00003289 releasePage(pToRelease);
drh3b7511c2001-05-26 13:15:44 +00003290 return SQLITE_OK;
3291}
3292
3293/*
drhbd03cae2001-06-02 02:40:57 +00003294** Change the MemPage.pParent pointer on the page whose number is
drh8b2f49b2001-06-08 00:21:52 +00003295** given in the second argument so that MemPage.pParent holds the
drhbd03cae2001-06-02 02:40:57 +00003296** pointer in the third argument.
3297*/
danielk1977afcdd022004-10-31 16:25:42 +00003298static int reparentPage(Btree *pBt, Pgno pgno, MemPage *pNewParent, int idx){
drhbd03cae2001-06-02 02:40:57 +00003299 MemPage *pThis;
drh4b70f112004-05-02 21:12:19 +00003300 unsigned char *aData;
drhbd03cae2001-06-02 02:40:57 +00003301
danielk1977afcdd022004-10-31 16:25:42 +00003302 if( pgno==0 ) return SQLITE_OK;
drh4b70f112004-05-02 21:12:19 +00003303 assert( pBt->pPager!=0 );
drha34b6762004-05-07 13:30:42 +00003304 aData = sqlite3pager_lookup(pBt->pPager, pgno);
drhda200cc2004-05-09 11:51:38 +00003305 if( aData ){
drh887dc4c2004-10-22 16:22:57 +00003306 pThis = (MemPage*)&aData[pBt->psAligned];
drh31276532004-09-27 12:20:52 +00003307 assert( pThis->aData==aData );
drhda200cc2004-05-09 11:51:38 +00003308 if( pThis->isInit ){
3309 if( pThis->pParent!=pNewParent ){
3310 if( pThis->pParent ) sqlite3pager_unref(pThis->pParent->aData);
3311 pThis->pParent = pNewParent;
3312 if( pNewParent ) sqlite3pager_ref(pNewParent->aData);
3313 }
3314 pThis->idxParent = idx;
drhdd793422001-06-28 01:54:48 +00003315 }
drha34b6762004-05-07 13:30:42 +00003316 sqlite3pager_unref(aData);
drhbd03cae2001-06-02 02:40:57 +00003317 }
danielk1977afcdd022004-10-31 16:25:42 +00003318
3319#ifndef SQLITE_OMIT_AUTOVACUUM
3320 if( pBt->autoVacuum ){
3321 return ptrmapPut(pBt, pgno, PTRMAP_BTREE, pNewParent->pgno);
3322 }
3323#endif
3324 return SQLITE_OK;
drhbd03cae2001-06-02 02:40:57 +00003325}
3326
3327/*
drh4b70f112004-05-02 21:12:19 +00003328** Change the pParent pointer of all children of pPage to point back
3329** to pPage.
3330**
drhbd03cae2001-06-02 02:40:57 +00003331** In other words, for every child of pPage, invoke reparentPage()
drh5e00f6c2001-09-13 13:46:56 +00003332** to make sure that each child knows that pPage is its parent.
drhbd03cae2001-06-02 02:40:57 +00003333**
3334** This routine gets called after you memcpy() one page into
3335** another.
3336*/
danielk1977afcdd022004-10-31 16:25:42 +00003337static int reparentChildPages(MemPage *pPage){
drhbd03cae2001-06-02 02:40:57 +00003338 int i;
danielk1977afcdd022004-10-31 16:25:42 +00003339 Btree *pBt = pPage->pBt;
3340 int rc = SQLITE_OK;
drh4b70f112004-05-02 21:12:19 +00003341
danielk1977afcdd022004-10-31 16:25:42 +00003342#ifdef SQLITE_OMIT_AUTOVACUUM
3343 if( pPage->leaf ) return SQLITE_OK;
3344#else
3345 if( !pBt->autoVacuum && pPage->leaf ) return SQLITE_OK;
3346#endif
3347
drhbd03cae2001-06-02 02:40:57 +00003348 for(i=0; i<pPage->nCell; i++){
danielk1977afcdd022004-10-31 16:25:42 +00003349 u8 *pCell = findCell(pPage, i);
3350 if( !pPage->leaf ){
3351 rc = reparentPage(pBt, get4byte(pCell), pPage, i);
3352 if( rc!=SQLITE_OK ) return rc;
3353 }
3354#ifndef SQLITE_OMIT_AUTOVACUUM
3355 /* If the database supports auto-vacuum, then check each cell to see
3356 ** if it contains a pointer to an overflow page. If so, then the
3357 ** pointer-map must be updated accordingly.
3358 **
3359 ** TODO: This looks like quite an expensive thing to do. Investigate.
3360 */
3361 if( pBt->autoVacuum ){
3362 CellInfo info;
3363 parseCellPtr(pPage, pCell, &info);
danielk1977e80463b2004-11-03 03:01:16 +00003364 if( (info.nData+(pPage->intKey?0:info.nKey))>info.nLocal ){
danielk1977afcdd022004-10-31 16:25:42 +00003365 Pgno pgnoOvfl = get4byte(&pCell[info.iOverflow]);
danielk1977687566d2004-11-02 12:56:41 +00003366 rc = ptrmapPut(pBt, pgnoOvfl, PTRMAP_OVERFLOW1, pPage->pgno);
danielk1977afcdd022004-10-31 16:25:42 +00003367 if( rc!=SQLITE_OK ) return rc;
3368 }
3369 }
3370#endif
drhbd03cae2001-06-02 02:40:57 +00003371 }
danielk1977afcdd022004-10-31 16:25:42 +00003372 if( !pPage->leaf ){
3373 rc = reparentPage(pBt, get4byte(&pPage->aData[pPage->hdrOffset+8]),
3374 pPage, i);
3375 pPage->idxShift = 0;
3376 }
3377 return rc;
drh14acc042001-06-10 19:56:58 +00003378}
3379
3380/*
3381** Remove the i-th cell from pPage. This routine effects pPage only.
3382** The cell content is not freed or deallocated. It is assumed that
3383** the cell content has been copied someplace else. This routine just
3384** removes the reference to the cell from pPage.
3385**
3386** "sz" must be the number of bytes in the cell.
drh14acc042001-06-10 19:56:58 +00003387*/
drh4b70f112004-05-02 21:12:19 +00003388static void dropCell(MemPage *pPage, int idx, int sz){
drh43605152004-05-29 21:46:49 +00003389 int i; /* Loop counter */
3390 int pc; /* Offset to cell content of cell being deleted */
3391 u8 *data; /* pPage->aData */
3392 u8 *ptr; /* Used to move bytes around within data[] */
3393
drh8c42ca92001-06-22 19:15:00 +00003394 assert( idx>=0 && idx<pPage->nCell );
drh43605152004-05-29 21:46:49 +00003395 assert( sz==cellSize(pPage, idx) );
drha34b6762004-05-07 13:30:42 +00003396 assert( sqlite3pager_iswriteable(pPage->aData) );
drhda200cc2004-05-09 11:51:38 +00003397 data = pPage->aData;
drh43605152004-05-29 21:46:49 +00003398 ptr = &data[pPage->cellOffset + 2*idx];
3399 pc = get2byte(ptr);
3400 assert( pc>10 && pc+sz<=pPage->pBt->usableSize );
drhde647132004-05-07 17:57:49 +00003401 freeSpace(pPage, pc, sz);
drh43605152004-05-29 21:46:49 +00003402 for(i=idx+1; i<pPage->nCell; i++, ptr+=2){
3403 ptr[0] = ptr[2];
3404 ptr[1] = ptr[3];
drh14acc042001-06-10 19:56:58 +00003405 }
3406 pPage->nCell--;
drh43605152004-05-29 21:46:49 +00003407 put2byte(&data[pPage->hdrOffset+3], pPage->nCell);
3408 pPage->nFree += 2;
drh428ae8c2003-01-04 16:48:09 +00003409 pPage->idxShift = 1;
drh14acc042001-06-10 19:56:58 +00003410}
3411
3412/*
3413** Insert a new cell on pPage at cell index "i". pCell points to the
3414** content of the cell.
3415**
3416** If the cell content will fit on the page, then put it there. If it
drh43605152004-05-29 21:46:49 +00003417** will not fit, then make a copy of the cell content into pTemp if
3418** pTemp is not null. Regardless of pTemp, allocate a new entry
3419** in pPage->aOvfl[] and make it point to the cell content (either
3420** in pTemp or the original pCell) and also record its index.
3421** Allocating a new entry in pPage->aCell[] implies that
3422** pPage->nOverflow is incremented.
drh14acc042001-06-10 19:56:58 +00003423*/
danielk1977e80463b2004-11-03 03:01:16 +00003424static int insertCell(
drh24cd67e2004-05-10 16:18:47 +00003425 MemPage *pPage, /* Page into which we are copying */
drh43605152004-05-29 21:46:49 +00003426 int i, /* New cell becomes the i-th cell of the page */
3427 u8 *pCell, /* Content of the new cell */
3428 int sz, /* Bytes of content in pCell */
drh24cd67e2004-05-10 16:18:47 +00003429 u8 *pTemp /* Temp storage space for pCell, if needed */
3430){
drh43605152004-05-29 21:46:49 +00003431 int idx; /* Where to write new cell content in data[] */
3432 int j; /* Loop counter */
3433 int top; /* First byte of content for any cell in data[] */
3434 int end; /* First byte past the last cell pointer in data[] */
3435 int ins; /* Index in data[] where new cell pointer is inserted */
3436 int hdr; /* Offset into data[] of the page header */
3437 int cellOffset; /* Address of first cell pointer in data[] */
3438 u8 *data; /* The content of the whole page */
3439 u8 *ptr; /* Used for moving information around in data[] */
3440
3441 assert( i>=0 && i<=pPage->nCell+pPage->nOverflow );
3442 assert( sz==cellSizePtr(pPage, pCell) );
drha34b6762004-05-07 13:30:42 +00003443 assert( sqlite3pager_iswriteable(pPage->aData) );
drh43605152004-05-29 21:46:49 +00003444 if( pPage->nOverflow || sz+2>pPage->nFree ){
drh24cd67e2004-05-10 16:18:47 +00003445 if( pTemp ){
3446 memcpy(pTemp, pCell, sz);
drh43605152004-05-29 21:46:49 +00003447 pCell = pTemp;
drh24cd67e2004-05-10 16:18:47 +00003448 }
drh43605152004-05-29 21:46:49 +00003449 j = pPage->nOverflow++;
3450 assert( j<sizeof(pPage->aOvfl)/sizeof(pPage->aOvfl[0]) );
3451 pPage->aOvfl[j].pCell = pCell;
3452 pPage->aOvfl[j].idx = i;
3453 pPage->nFree = 0;
drh14acc042001-06-10 19:56:58 +00003454 }else{
drh43605152004-05-29 21:46:49 +00003455 data = pPage->aData;
3456 hdr = pPage->hdrOffset;
3457 top = get2byte(&data[hdr+5]);
3458 cellOffset = pPage->cellOffset;
3459 end = cellOffset + 2*pPage->nCell + 2;
3460 ins = cellOffset + 2*i;
3461 if( end > top - sz ){
3462 defragmentPage(pPage);
3463 top = get2byte(&data[hdr+5]);
3464 assert( end + sz <= top );
3465 }
3466 idx = allocateSpace(pPage, sz);
3467 assert( idx>0 );
3468 assert( end <= get2byte(&data[hdr+5]) );
3469 pPage->nCell++;
3470 pPage->nFree -= 2;
drhda200cc2004-05-09 11:51:38 +00003471 memcpy(&data[idx], pCell, sz);
drh43605152004-05-29 21:46:49 +00003472 for(j=end-2, ptr=&data[j]; j>ins; j-=2, ptr-=2){
3473 ptr[0] = ptr[-2];
3474 ptr[1] = ptr[-1];
drhda200cc2004-05-09 11:51:38 +00003475 }
drh43605152004-05-29 21:46:49 +00003476 put2byte(&data[ins], idx);
3477 put2byte(&data[hdr+3], pPage->nCell);
3478 pPage->idxShift = 1;
drhda200cc2004-05-09 11:51:38 +00003479 pageIntegrity(pPage);
danielk1977a19df672004-11-03 11:37:07 +00003480#ifndef SQLITE_OMIT_AUTOVACUUM
3481 if( pPage->pBt->autoVacuum ){
3482 /* The cell may contain a pointer to an overflow page. If so, write
3483 ** the entry for the overflow page into the pointer map.
3484 */
3485 CellInfo info;
3486 parseCellPtr(pPage, pCell, &info);
3487 if( (info.nData+(pPage->intKey?0:info.nKey))>info.nLocal ){
3488 Pgno pgnoOvfl = get4byte(&pCell[info.iOverflow]);
3489 int rc = ptrmapPut(pPage->pBt, pgnoOvfl, PTRMAP_OVERFLOW1, pPage->pgno);
3490 if( rc!=SQLITE_OK ) return rc;
3491 }
3492 }
3493#endif
drh14acc042001-06-10 19:56:58 +00003494 }
danielk1977e80463b2004-11-03 03:01:16 +00003495
danielk1977e80463b2004-11-03 03:01:16 +00003496 return SQLITE_OK;
drh14acc042001-06-10 19:56:58 +00003497}
3498
3499/*
drhfa1a98a2004-05-14 19:08:17 +00003500** Add a list of cells to a page. The page should be initially empty.
3501** The cells are guaranteed to fit on the page.
3502*/
3503static void assemblePage(
3504 MemPage *pPage, /* The page to be assemblied */
3505 int nCell, /* The number of cells to add to this page */
drh43605152004-05-29 21:46:49 +00003506 u8 **apCell, /* Pointers to cell bodies */
drhfa1a98a2004-05-14 19:08:17 +00003507 int *aSize /* Sizes of the cells */
3508){
3509 int i; /* Loop counter */
3510 int totalSize; /* Total size of all cells */
3511 int hdr; /* Index of page header */
drh43605152004-05-29 21:46:49 +00003512 int cellptr; /* Address of next cell pointer */
3513 int cellbody; /* Address of next cell body */
drhfa1a98a2004-05-14 19:08:17 +00003514 u8 *data; /* Data for the page */
3515
drh43605152004-05-29 21:46:49 +00003516 assert( pPage->nOverflow==0 );
drhfa1a98a2004-05-14 19:08:17 +00003517 totalSize = 0;
3518 for(i=0; i<nCell; i++){
3519 totalSize += aSize[i];
3520 }
drh43605152004-05-29 21:46:49 +00003521 assert( totalSize+2*nCell<=pPage->nFree );
drhfa1a98a2004-05-14 19:08:17 +00003522 assert( pPage->nCell==0 );
drh43605152004-05-29 21:46:49 +00003523 cellptr = pPage->cellOffset;
drhfa1a98a2004-05-14 19:08:17 +00003524 data = pPage->aData;
3525 hdr = pPage->hdrOffset;
drh43605152004-05-29 21:46:49 +00003526 put2byte(&data[hdr+3], nCell);
3527 cellbody = allocateSpace(pPage, totalSize);
3528 assert( cellbody>0 );
3529 assert( pPage->nFree >= 2*nCell );
3530 pPage->nFree -= 2*nCell;
drhfa1a98a2004-05-14 19:08:17 +00003531 for(i=0; i<nCell; i++){
drh43605152004-05-29 21:46:49 +00003532 put2byte(&data[cellptr], cellbody);
3533 memcpy(&data[cellbody], apCell[i], aSize[i]);
3534 cellptr += 2;
3535 cellbody += aSize[i];
drhfa1a98a2004-05-14 19:08:17 +00003536 }
drh43605152004-05-29 21:46:49 +00003537 assert( cellbody==pPage->pBt->usableSize );
drhfa1a98a2004-05-14 19:08:17 +00003538 pPage->nCell = nCell;
drhfa1a98a2004-05-14 19:08:17 +00003539}
3540
drh14acc042001-06-10 19:56:58 +00003541/*
drhc3b70572003-01-04 19:44:07 +00003542** The following parameters determine how many adjacent pages get involved
3543** in a balancing operation. NN is the number of neighbors on either side
3544** of the page that participate in the balancing operation. NB is the
3545** total number of pages that participate, including the target page and
3546** NN neighbors on either side.
3547**
3548** The minimum value of NN is 1 (of course). Increasing NN above 1
3549** (to 2 or 3) gives a modest improvement in SELECT and DELETE performance
3550** in exchange for a larger degradation in INSERT and UPDATE performance.
3551** The value of NN appears to give the best results overall.
3552*/
3553#define NN 1 /* Number of neighbors on either side of pPage */
3554#define NB (NN*2+1) /* Total pages involved in the balance */
3555
drh43605152004-05-29 21:46:49 +00003556/* Forward reference */
3557static int balance(MemPage*);
3558
drhc3b70572003-01-04 19:44:07 +00003559/*
drhab01f612004-05-22 02:55:23 +00003560** This routine redistributes Cells on pPage and up to NN*2 siblings
drh8b2f49b2001-06-08 00:21:52 +00003561** of pPage so that all pages have about the same amount of free space.
drh0c6cc4e2004-06-15 02:13:26 +00003562** Usually NN siblings on either side of pPage is used in the balancing,
3563** though more siblings might come from one side if pPage is the first
drhab01f612004-05-22 02:55:23 +00003564** or last child of its parent. If pPage has fewer than 2*NN siblings
drh8b2f49b2001-06-08 00:21:52 +00003565** (something which can only happen if pPage is the root page or a
drh14acc042001-06-10 19:56:58 +00003566** child of root) then all available siblings participate in the balancing.
drh8b2f49b2001-06-08 00:21:52 +00003567**
drh0c6cc4e2004-06-15 02:13:26 +00003568** The number of siblings of pPage might be increased or decreased by one or
3569** two in an effort to keep pages nearly full but not over full. The root page
drhab01f612004-05-22 02:55:23 +00003570** is special and is allowed to be nearly empty. If pPage is
drh8c42ca92001-06-22 19:15:00 +00003571** the root page, then the depth of the tree might be increased
drh8b2f49b2001-06-08 00:21:52 +00003572** or decreased by one, as necessary, to keep the root page from being
drhab01f612004-05-22 02:55:23 +00003573** overfull or completely empty.
drh14acc042001-06-10 19:56:58 +00003574**
drh8b2f49b2001-06-08 00:21:52 +00003575** Note that when this routine is called, some of the Cells on pPage
drh4b70f112004-05-02 21:12:19 +00003576** might not actually be stored in pPage->aData[]. This can happen
drh8b2f49b2001-06-08 00:21:52 +00003577** if the page is overfull. Part of the job of this routine is to
drh4b70f112004-05-02 21:12:19 +00003578** make sure all Cells for pPage once again fit in pPage->aData[].
drh14acc042001-06-10 19:56:58 +00003579**
drh8c42ca92001-06-22 19:15:00 +00003580** In the course of balancing the siblings of pPage, the parent of pPage
3581** might become overfull or underfull. If that happens, then this routine
3582** is called recursively on the parent.
3583**
drh5e00f6c2001-09-13 13:46:56 +00003584** If this routine fails for any reason, it might leave the database
3585** in a corrupted state. So if this routine fails, the database should
3586** be rolled back.
drh8b2f49b2001-06-08 00:21:52 +00003587*/
drh43605152004-05-29 21:46:49 +00003588static int balance_nonroot(MemPage *pPage){
drh8b2f49b2001-06-08 00:21:52 +00003589 MemPage *pParent; /* The parent of pPage */
drh4b70f112004-05-02 21:12:19 +00003590 Btree *pBt; /* The whole database */
danielk1977cfe9a692004-06-16 12:00:29 +00003591 int nCell = 0; /* Number of cells in aCell[] */
drh8b2f49b2001-06-08 00:21:52 +00003592 int nOld; /* Number of pages in apOld[] */
3593 int nNew; /* Number of pages in apNew[] */
drh8b2f49b2001-06-08 00:21:52 +00003594 int nDiv; /* Number of cells in apDiv[] */
drh14acc042001-06-10 19:56:58 +00003595 int i, j, k; /* Loop counters */
drha34b6762004-05-07 13:30:42 +00003596 int idx; /* Index of pPage in pParent->aCell[] */
3597 int nxDiv; /* Next divider slot in pParent->aCell[] */
drh14acc042001-06-10 19:56:58 +00003598 int rc; /* The return code */
drh91025292004-05-03 19:49:32 +00003599 int leafCorrection; /* 4 if pPage is a leaf. 0 if not */
drh8b18dd42004-05-12 19:18:15 +00003600 int leafData; /* True if pPage is a leaf of a LEAFDATA tree */
drh91025292004-05-03 19:49:32 +00003601 int usableSpace; /* Bytes in pPage beyond the header */
3602 int pageFlags; /* Value of pPage->aData[0] */
drh6019e162001-07-02 17:51:45 +00003603 int subtotal; /* Subtotal of bytes in cells on one page */
drhb6f41482004-05-14 01:58:11 +00003604 int iSpace = 0; /* First unused byte of aSpace[] */
drh2e38c322004-09-03 18:38:44 +00003605 int mxCellPerPage; /* Maximum number of cells in one page */
drhc3b70572003-01-04 19:44:07 +00003606 MemPage *apOld[NB]; /* pPage and up to two siblings */
3607 Pgno pgnoOld[NB]; /* Page numbers for each page in apOld[] */
drh4b70f112004-05-02 21:12:19 +00003608 MemPage *apCopy[NB]; /* Private copies of apOld[] pages */
drha2fce642004-06-05 00:01:44 +00003609 MemPage *apNew[NB+2]; /* pPage and up to NB siblings after balancing */
3610 Pgno pgnoNew[NB+2]; /* Page numbers for each page in apNew[] */
drhc3b70572003-01-04 19:44:07 +00003611 int idxDiv[NB]; /* Indices of divider cells in pParent */
drh4b70f112004-05-02 21:12:19 +00003612 u8 *apDiv[NB]; /* Divider cells in pParent */
drha2fce642004-06-05 00:01:44 +00003613 int cntNew[NB+2]; /* Index in aCell[] of cell after i-th page */
3614 int szNew[NB+2]; /* Combined size of cells place on i-th page */
drh2e38c322004-09-03 18:38:44 +00003615 u8 **apCell; /* All cells begin balanced */
3616 int *szCell; /* Local size of all cells in apCell[] */
3617 u8 *aCopy[NB]; /* Space for holding data of apCopy[] */
3618 u8 *aSpace; /* Space to hold copies of dividers cells */
drh8b2f49b2001-06-08 00:21:52 +00003619
drh14acc042001-06-10 19:56:58 +00003620 /*
drh43605152004-05-29 21:46:49 +00003621 ** Find the parent page.
drh8b2f49b2001-06-08 00:21:52 +00003622 */
drh3a4c1412004-05-09 20:40:11 +00003623 assert( pPage->isInit );
drha34b6762004-05-07 13:30:42 +00003624 assert( sqlite3pager_iswriteable(pPage->aData) );
drh4b70f112004-05-02 21:12:19 +00003625 pBt = pPage->pBt;
drh14acc042001-06-10 19:56:58 +00003626 pParent = pPage->pParent;
drh43605152004-05-29 21:46:49 +00003627 sqlite3pager_write(pParent->aData);
3628 assert( pParent );
3629 TRACE(("BALANCE: begin page %d child of %d\n", pPage->pgno, pParent->pgno));
drh2e38c322004-09-03 18:38:44 +00003630
3631 /*
3632 ** Allocate space for memory structures
3633 */
3634 mxCellPerPage = MX_CELL(pBt);
3635 apCell = sqliteMallocRaw(
3636 (mxCellPerPage+2)*NB*(sizeof(u8*)+sizeof(int))
3637 + sizeof(MemPage)*NB
drh887dc4c2004-10-22 16:22:57 +00003638 + pBt->psAligned*(5+NB)
drh2e38c322004-09-03 18:38:44 +00003639 );
3640 if( apCell==0 ){
3641 return SQLITE_NOMEM;
3642 }
3643 szCell = (int*)&apCell[(mxCellPerPage+2)*NB];
3644 aCopy[0] = (u8*)&szCell[(mxCellPerPage+2)*NB];
3645 for(i=1; i<NB; i++){
drh887dc4c2004-10-22 16:22:57 +00003646 aCopy[i] = &aCopy[i-1][pBt->psAligned+sizeof(MemPage)];
drh2e38c322004-09-03 18:38:44 +00003647 }
drh887dc4c2004-10-22 16:22:57 +00003648 aSpace = &aCopy[NB-1][pBt->psAligned+sizeof(MemPage)];
drh14acc042001-06-10 19:56:58 +00003649
drh8b2f49b2001-06-08 00:21:52 +00003650 /*
drh4b70f112004-05-02 21:12:19 +00003651 ** Find the cell in the parent page whose left child points back
drh14acc042001-06-10 19:56:58 +00003652 ** to pPage. The "idx" variable is the index of that cell. If pPage
3653 ** is the rightmost child of pParent then set idx to pParent->nCell
drh8b2f49b2001-06-08 00:21:52 +00003654 */
drhbb49aba2003-01-04 18:53:27 +00003655 if( pParent->idxShift ){
drha34b6762004-05-07 13:30:42 +00003656 Pgno pgno;
drh4b70f112004-05-02 21:12:19 +00003657 pgno = pPage->pgno;
drha34b6762004-05-07 13:30:42 +00003658 assert( pgno==sqlite3pager_pagenumber(pPage->aData) );
drhbb49aba2003-01-04 18:53:27 +00003659 for(idx=0; idx<pParent->nCell; idx++){
drh43605152004-05-29 21:46:49 +00003660 if( get4byte(findCell(pParent, idx))==pgno ){
drhbb49aba2003-01-04 18:53:27 +00003661 break;
3662 }
drh8b2f49b2001-06-08 00:21:52 +00003663 }
drh4b70f112004-05-02 21:12:19 +00003664 assert( idx<pParent->nCell
drh43605152004-05-29 21:46:49 +00003665 || get4byte(&pParent->aData[pParent->hdrOffset+8])==pgno );
drhbb49aba2003-01-04 18:53:27 +00003666 }else{
3667 idx = pPage->idxParent;
drh8b2f49b2001-06-08 00:21:52 +00003668 }
drh8b2f49b2001-06-08 00:21:52 +00003669
3670 /*
drh14acc042001-06-10 19:56:58 +00003671 ** Initialize variables so that it will be safe to jump
drh5edc3122001-09-13 21:53:09 +00003672 ** directly to balance_cleanup at any moment.
drh8b2f49b2001-06-08 00:21:52 +00003673 */
drh14acc042001-06-10 19:56:58 +00003674 nOld = nNew = 0;
drha34b6762004-05-07 13:30:42 +00003675 sqlite3pager_ref(pParent->aData);
drh14acc042001-06-10 19:56:58 +00003676
3677 /*
drh4b70f112004-05-02 21:12:19 +00003678 ** Find sibling pages to pPage and the cells in pParent that divide
drhc3b70572003-01-04 19:44:07 +00003679 ** the siblings. An attempt is made to find NN siblings on either
3680 ** side of pPage. More siblings are taken from one side, however, if
3681 ** pPage there are fewer than NN siblings on the other side. If pParent
3682 ** has NB or fewer children then all children of pParent are taken.
drh14acc042001-06-10 19:56:58 +00003683 */
drhc3b70572003-01-04 19:44:07 +00003684 nxDiv = idx - NN;
3685 if( nxDiv + NB > pParent->nCell ){
3686 nxDiv = pParent->nCell - NB + 1;
drh8b2f49b2001-06-08 00:21:52 +00003687 }
drhc3b70572003-01-04 19:44:07 +00003688 if( nxDiv<0 ){
3689 nxDiv = 0;
3690 }
drh8b2f49b2001-06-08 00:21:52 +00003691 nDiv = 0;
drhc3b70572003-01-04 19:44:07 +00003692 for(i=0, k=nxDiv; i<NB; i++, k++){
drh14acc042001-06-10 19:56:58 +00003693 if( k<pParent->nCell ){
3694 idxDiv[i] = k;
drh43605152004-05-29 21:46:49 +00003695 apDiv[i] = findCell(pParent, k);
drh8b2f49b2001-06-08 00:21:52 +00003696 nDiv++;
drha34b6762004-05-07 13:30:42 +00003697 assert( !pParent->leaf );
drh43605152004-05-29 21:46:49 +00003698 pgnoOld[i] = get4byte(apDiv[i]);
drh14acc042001-06-10 19:56:58 +00003699 }else if( k==pParent->nCell ){
drh43605152004-05-29 21:46:49 +00003700 pgnoOld[i] = get4byte(&pParent->aData[pParent->hdrOffset+8]);
drh14acc042001-06-10 19:56:58 +00003701 }else{
3702 break;
drh8b2f49b2001-06-08 00:21:52 +00003703 }
drhde647132004-05-07 17:57:49 +00003704 rc = getAndInitPage(pBt, pgnoOld[i], &apOld[i], pParent);
drh6019e162001-07-02 17:51:45 +00003705 if( rc ) goto balance_cleanup;
drh428ae8c2003-01-04 16:48:09 +00003706 apOld[i]->idxParent = k;
drh91025292004-05-03 19:49:32 +00003707 apCopy[i] = 0;
3708 assert( i==nOld );
drh14acc042001-06-10 19:56:58 +00003709 nOld++;
drh8b2f49b2001-06-08 00:21:52 +00003710 }
3711
3712 /*
drh14acc042001-06-10 19:56:58 +00003713 ** Make copies of the content of pPage and its siblings into aOld[].
3714 ** The rest of this function will use data from the copies rather
3715 ** that the original pages since the original pages will be in the
3716 ** process of being overwritten.
3717 */
3718 for(i=0; i<nOld; i++){
drh887dc4c2004-10-22 16:22:57 +00003719 MemPage *p = apCopy[i] = (MemPage*)&aCopy[i][pBt->psAligned];
3720 p->aData = &((u8*)p)[-pBt->psAligned];
3721 memcpy(p->aData, apOld[i]->aData, pBt->psAligned + sizeof(MemPage));
3722 p->aData = &((u8*)p)[-pBt->psAligned];
drh14acc042001-06-10 19:56:58 +00003723 }
3724
3725 /*
3726 ** Load pointers to all cells on sibling pages and the divider cells
3727 ** into the local apCell[] array. Make copies of the divider cells
drhb6f41482004-05-14 01:58:11 +00003728 ** into space obtained form aSpace[] and remove the the divider Cells
3729 ** from pParent.
drh4b70f112004-05-02 21:12:19 +00003730 **
3731 ** If the siblings are on leaf pages, then the child pointers of the
3732 ** divider cells are stripped from the cells before they are copied
drh96f5b762004-05-16 16:24:36 +00003733 ** into aSpace[]. In this way, all cells in apCell[] are without
drh4b70f112004-05-02 21:12:19 +00003734 ** child pointers. If siblings are not leaves, then all cell in
3735 ** apCell[] include child pointers. Either way, all cells in apCell[]
3736 ** are alike.
drh96f5b762004-05-16 16:24:36 +00003737 **
3738 ** leafCorrection: 4 if pPage is a leaf. 0 if pPage is not a leaf.
3739 ** leafData: 1 if pPage holds key+data and pParent holds only keys.
drh8b2f49b2001-06-08 00:21:52 +00003740 */
3741 nCell = 0;
drh4b70f112004-05-02 21:12:19 +00003742 leafCorrection = pPage->leaf*4;
drh8b18dd42004-05-12 19:18:15 +00003743 leafData = pPage->leafData && pPage->leaf;
drh8b2f49b2001-06-08 00:21:52 +00003744 for(i=0; i<nOld; i++){
drh4b70f112004-05-02 21:12:19 +00003745 MemPage *pOld = apCopy[i];
drh43605152004-05-29 21:46:49 +00003746 int limit = pOld->nCell+pOld->nOverflow;
3747 for(j=0; j<limit; j++){
3748 apCell[nCell] = findOverflowCell(pOld, j);
3749 szCell[nCell] = cellSizePtr(pOld, apCell[nCell]);
drh14acc042001-06-10 19:56:58 +00003750 nCell++;
drh8b2f49b2001-06-08 00:21:52 +00003751 }
3752 if( i<nOld-1 ){
drh43605152004-05-29 21:46:49 +00003753 int sz = cellSizePtr(pParent, apDiv[i]);
drh8b18dd42004-05-12 19:18:15 +00003754 if( leafData ){
drh96f5b762004-05-16 16:24:36 +00003755 /* With the LEAFDATA flag, pParent cells hold only INTKEYs that
3756 ** are duplicates of keys on the child pages. We need to remove
3757 ** the divider cells from pParent, but the dividers cells are not
3758 ** added to apCell[] because they are duplicates of child cells.
3759 */
drh8b18dd42004-05-12 19:18:15 +00003760 dropCell(pParent, nxDiv, sz);
drh4b70f112004-05-02 21:12:19 +00003761 }else{
drhb6f41482004-05-14 01:58:11 +00003762 u8 *pTemp;
3763 szCell[nCell] = sz;
3764 pTemp = &aSpace[iSpace];
3765 iSpace += sz;
drh887dc4c2004-10-22 16:22:57 +00003766 assert( iSpace<=pBt->psAligned*5 );
drhb6f41482004-05-14 01:58:11 +00003767 memcpy(pTemp, apDiv[i], sz);
3768 apCell[nCell] = pTemp+leafCorrection;
3769 dropCell(pParent, nxDiv, sz);
drh8b18dd42004-05-12 19:18:15 +00003770 szCell[nCell] -= leafCorrection;
drh43605152004-05-29 21:46:49 +00003771 assert( get4byte(pTemp)==pgnoOld[i] );
drh8b18dd42004-05-12 19:18:15 +00003772 if( !pOld->leaf ){
3773 assert( leafCorrection==0 );
3774 /* The right pointer of the child page pOld becomes the left
3775 ** pointer of the divider cell */
drh43605152004-05-29 21:46:49 +00003776 memcpy(apCell[nCell], &pOld->aData[pOld->hdrOffset+8], 4);
drh8b18dd42004-05-12 19:18:15 +00003777 }else{
3778 assert( leafCorrection==4 );
3779 }
3780 nCell++;
drh4b70f112004-05-02 21:12:19 +00003781 }
drh8b2f49b2001-06-08 00:21:52 +00003782 }
3783 }
3784
3785 /*
drh6019e162001-07-02 17:51:45 +00003786 ** Figure out the number of pages needed to hold all nCell cells.
3787 ** Store this number in "k". Also compute szNew[] which is the total
3788 ** size of all cells on the i-th page and cntNew[] which is the index
drh4b70f112004-05-02 21:12:19 +00003789 ** in apCell[] of the cell that divides page i from page i+1.
drh6019e162001-07-02 17:51:45 +00003790 ** cntNew[k] should equal nCell.
3791 **
drh96f5b762004-05-16 16:24:36 +00003792 ** Values computed by this block:
3793 **
3794 ** k: The total number of sibling pages
3795 ** szNew[i]: Spaced used on the i-th sibling page.
3796 ** cntNew[i]: Index in apCell[] and szCell[] for the first cell to
3797 ** the right of the i-th sibling page.
3798 ** usableSpace: Number of bytes of space available on each sibling.
3799 **
drh8b2f49b2001-06-08 00:21:52 +00003800 */
drh43605152004-05-29 21:46:49 +00003801 usableSpace = pBt->usableSize - 12 + leafCorrection;
drh6019e162001-07-02 17:51:45 +00003802 for(subtotal=k=i=0; i<nCell; i++){
drh43605152004-05-29 21:46:49 +00003803 subtotal += szCell[i] + 2;
drh4b70f112004-05-02 21:12:19 +00003804 if( subtotal > usableSpace ){
drh6019e162001-07-02 17:51:45 +00003805 szNew[k] = subtotal - szCell[i];
3806 cntNew[k] = i;
drh8b18dd42004-05-12 19:18:15 +00003807 if( leafData ){ i--; }
drh6019e162001-07-02 17:51:45 +00003808 subtotal = 0;
3809 k++;
3810 }
3811 }
3812 szNew[k] = subtotal;
3813 cntNew[k] = nCell;
3814 k++;
drh96f5b762004-05-16 16:24:36 +00003815
3816 /*
3817 ** The packing computed by the previous block is biased toward the siblings
3818 ** on the left side. The left siblings are always nearly full, while the
3819 ** right-most sibling might be nearly empty. This block of code attempts
3820 ** to adjust the packing of siblings to get a better balance.
3821 **
3822 ** This adjustment is more than an optimization. The packing above might
3823 ** be so out of balance as to be illegal. For example, the right-most
3824 ** sibling might be completely empty. This adjustment is not optional.
3825 */
drh6019e162001-07-02 17:51:45 +00003826 for(i=k-1; i>0; i--){
drh96f5b762004-05-16 16:24:36 +00003827 int szRight = szNew[i]; /* Size of sibling on the right */
3828 int szLeft = szNew[i-1]; /* Size of sibling on the left */
3829 int r; /* Index of right-most cell in left sibling */
3830 int d; /* Index of first cell to the left of right sibling */
3831
3832 r = cntNew[i-1] - 1;
3833 d = r + 1 - leafData;
drh43605152004-05-29 21:46:49 +00003834 while( szRight==0 || szRight+szCell[d]+2<=szLeft-(szCell[r]+2) ){
3835 szRight += szCell[d] + 2;
3836 szLeft -= szCell[r] + 2;
drh6019e162001-07-02 17:51:45 +00003837 cntNew[i-1]--;
drh96f5b762004-05-16 16:24:36 +00003838 r = cntNew[i-1] - 1;
3839 d = r + 1 - leafData;
drh6019e162001-07-02 17:51:45 +00003840 }
drh96f5b762004-05-16 16:24:36 +00003841 szNew[i] = szRight;
3842 szNew[i-1] = szLeft;
drh6019e162001-07-02 17:51:45 +00003843 }
3844 assert( cntNew[0]>0 );
drh8b2f49b2001-06-08 00:21:52 +00003845
3846 /*
drh6b308672002-07-08 02:16:37 +00003847 ** Allocate k new pages. Reuse old pages where possible.
drh8b2f49b2001-06-08 00:21:52 +00003848 */
drh4b70f112004-05-02 21:12:19 +00003849 assert( pPage->pgno>1 );
3850 pageFlags = pPage->aData[0];
drh14acc042001-06-10 19:56:58 +00003851 for(i=0; i<k; i++){
drhda200cc2004-05-09 11:51:38 +00003852 MemPage *pNew;
drh6b308672002-07-08 02:16:37 +00003853 if( i<nOld ){
drhda200cc2004-05-09 11:51:38 +00003854 pNew = apNew[i] = apOld[i];
drh6b308672002-07-08 02:16:37 +00003855 pgnoNew[i] = pgnoOld[i];
3856 apOld[i] = 0;
drhda200cc2004-05-09 11:51:38 +00003857 sqlite3pager_write(pNew->aData);
drh6b308672002-07-08 02:16:37 +00003858 }else{
danielk1977cb1a7eb2004-11-05 12:27:02 +00003859 rc = allocatePage(pBt, &pNew, &pgnoNew[i], pgnoNew[i-1], 0);
drh6b308672002-07-08 02:16:37 +00003860 if( rc ) goto balance_cleanup;
drhda200cc2004-05-09 11:51:38 +00003861 apNew[i] = pNew;
drh6b308672002-07-08 02:16:37 +00003862 }
drh14acc042001-06-10 19:56:58 +00003863 nNew++;
drhda200cc2004-05-09 11:51:38 +00003864 zeroPage(pNew, pageFlags);
drh8b2f49b2001-06-08 00:21:52 +00003865 }
3866
drh6b308672002-07-08 02:16:37 +00003867 /* Free any old pages that were not reused as new pages.
3868 */
3869 while( i<nOld ){
drh4b70f112004-05-02 21:12:19 +00003870 rc = freePage(apOld[i]);
drh6b308672002-07-08 02:16:37 +00003871 if( rc ) goto balance_cleanup;
drhda200cc2004-05-09 11:51:38 +00003872 releasePage(apOld[i]);
drh6b308672002-07-08 02:16:37 +00003873 apOld[i] = 0;
3874 i++;
3875 }
3876
drh8b2f49b2001-06-08 00:21:52 +00003877 /*
drhf9ffac92002-03-02 19:00:31 +00003878 ** Put the new pages in accending order. This helps to
3879 ** keep entries in the disk file in order so that a scan
3880 ** of the table is a linear scan through the file. That
3881 ** in turn helps the operating system to deliver pages
3882 ** from the disk more rapidly.
3883 **
3884 ** An O(n^2) insertion sort algorithm is used, but since
drhc3b70572003-01-04 19:44:07 +00003885 ** n is never more than NB (a small constant), that should
3886 ** not be a problem.
drhf9ffac92002-03-02 19:00:31 +00003887 **
drhc3b70572003-01-04 19:44:07 +00003888 ** When NB==3, this one optimization makes the database
3889 ** about 25% faster for large insertions and deletions.
drhf9ffac92002-03-02 19:00:31 +00003890 */
3891 for(i=0; i<k-1; i++){
3892 int minV = pgnoNew[i];
3893 int minI = i;
3894 for(j=i+1; j<k; j++){
drh7d02cb72003-06-04 16:24:39 +00003895 if( pgnoNew[j]<(unsigned)minV ){
drhf9ffac92002-03-02 19:00:31 +00003896 minI = j;
3897 minV = pgnoNew[j];
3898 }
3899 }
3900 if( minI>i ){
3901 int t;
3902 MemPage *pT;
3903 t = pgnoNew[i];
3904 pT = apNew[i];
3905 pgnoNew[i] = pgnoNew[minI];
3906 apNew[i] = apNew[minI];
3907 pgnoNew[minI] = t;
3908 apNew[minI] = pT;
3909 }
3910 }
drha2fce642004-06-05 00:01:44 +00003911 TRACE(("BALANCE: old: %d %d %d new: %d(%d) %d(%d) %d(%d) %d(%d) %d(%d)\n",
drh24cd67e2004-05-10 16:18:47 +00003912 pgnoOld[0],
3913 nOld>=2 ? pgnoOld[1] : 0,
3914 nOld>=3 ? pgnoOld[2] : 0,
drh10c0fa62004-05-18 12:50:17 +00003915 pgnoNew[0], szNew[0],
3916 nNew>=2 ? pgnoNew[1] : 0, nNew>=2 ? szNew[1] : 0,
3917 nNew>=3 ? pgnoNew[2] : 0, nNew>=3 ? szNew[2] : 0,
drha2fce642004-06-05 00:01:44 +00003918 nNew>=4 ? pgnoNew[3] : 0, nNew>=4 ? szNew[3] : 0,
3919 nNew>=5 ? pgnoNew[4] : 0, nNew>=5 ? szNew[4] : 0));
drh24cd67e2004-05-10 16:18:47 +00003920
drhf9ffac92002-03-02 19:00:31 +00003921
3922 /*
drh14acc042001-06-10 19:56:58 +00003923 ** Evenly distribute the data in apCell[] across the new pages.
3924 ** Insert divider cells into pParent as necessary.
3925 */
3926 j = 0;
3927 for(i=0; i<nNew; i++){
3928 MemPage *pNew = apNew[i];
drh4b70f112004-05-02 21:12:19 +00003929 assert( pNew->pgno==pgnoNew[i] );
drhfa1a98a2004-05-14 19:08:17 +00003930 assemblePage(pNew, cntNew[i]-j, &apCell[j], &szCell[j]);
3931 j = cntNew[i];
drh6019e162001-07-02 17:51:45 +00003932 assert( pNew->nCell>0 );
drh43605152004-05-29 21:46:49 +00003933 assert( pNew->nOverflow==0 );
drh14acc042001-06-10 19:56:58 +00003934 if( i<nNew-1 && j<nCell ){
drh8b18dd42004-05-12 19:18:15 +00003935 u8 *pCell;
drh24cd67e2004-05-10 16:18:47 +00003936 u8 *pTemp;
drh8b18dd42004-05-12 19:18:15 +00003937 int sz;
3938 pCell = apCell[j];
3939 sz = szCell[j] + leafCorrection;
drh4b70f112004-05-02 21:12:19 +00003940 if( !pNew->leaf ){
drh43605152004-05-29 21:46:49 +00003941 memcpy(&pNew->aData[8], pCell, 4);
drh24cd67e2004-05-10 16:18:47 +00003942 pTemp = 0;
drh8b18dd42004-05-12 19:18:15 +00003943 }else if( leafData ){
drh6f11bef2004-05-13 01:12:56 +00003944 CellInfo info;
drh8b18dd42004-05-12 19:18:15 +00003945 j--;
drh43605152004-05-29 21:46:49 +00003946 parseCellPtr(pNew, apCell[j], &info);
drhb6f41482004-05-14 01:58:11 +00003947 pCell = &aSpace[iSpace];
drh6f11bef2004-05-13 01:12:56 +00003948 fillInCell(pParent, pCell, 0, info.nKey, 0, 0, &sz);
drhb6f41482004-05-14 01:58:11 +00003949 iSpace += sz;
drh887dc4c2004-10-22 16:22:57 +00003950 assert( iSpace<=pBt->psAligned*5 );
drh8b18dd42004-05-12 19:18:15 +00003951 pTemp = 0;
drh4b70f112004-05-02 21:12:19 +00003952 }else{
3953 pCell -= 4;
drhb6f41482004-05-14 01:58:11 +00003954 pTemp = &aSpace[iSpace];
3955 iSpace += sz;
drh887dc4c2004-10-22 16:22:57 +00003956 assert( iSpace<=pBt->psAligned*5 );
drh4b70f112004-05-02 21:12:19 +00003957 }
danielk1977e80463b2004-11-03 03:01:16 +00003958 rc = insertCell(pParent, nxDiv, pCell, sz, pTemp);
3959 if( rc!=SQLITE_OK ) goto balance_cleanup;
drh43605152004-05-29 21:46:49 +00003960 put4byte(findOverflowCell(pParent,nxDiv), pNew->pgno);
drh14acc042001-06-10 19:56:58 +00003961 j++;
3962 nxDiv++;
3963 }
3964 }
drh6019e162001-07-02 17:51:45 +00003965 assert( j==nCell );
drh4b70f112004-05-02 21:12:19 +00003966 if( (pageFlags & PTF_LEAF)==0 ){
drh43605152004-05-29 21:46:49 +00003967 memcpy(&apNew[nNew-1]->aData[8], &apCopy[nOld-1]->aData[8], 4);
drh14acc042001-06-10 19:56:58 +00003968 }
drh43605152004-05-29 21:46:49 +00003969 if( nxDiv==pParent->nCell+pParent->nOverflow ){
drh4b70f112004-05-02 21:12:19 +00003970 /* Right-most sibling is the right-most child of pParent */
drh43605152004-05-29 21:46:49 +00003971 put4byte(&pParent->aData[pParent->hdrOffset+8], pgnoNew[nNew-1]);
drh4b70f112004-05-02 21:12:19 +00003972 }else{
3973 /* Right-most sibling is the left child of the first entry in pParent
3974 ** past the right-most divider entry */
drh43605152004-05-29 21:46:49 +00003975 put4byte(findOverflowCell(pParent, nxDiv), pgnoNew[nNew-1]);
drh14acc042001-06-10 19:56:58 +00003976 }
3977
3978 /*
3979 ** Reparent children of all cells.
drh8b2f49b2001-06-08 00:21:52 +00003980 */
3981 for(i=0; i<nNew; i++){
danielk1977afcdd022004-10-31 16:25:42 +00003982 rc = reparentChildPages(apNew[i]);
3983 if( rc!=SQLITE_OK ) goto balance_cleanup;
drh8b2f49b2001-06-08 00:21:52 +00003984 }
danielk1977afcdd022004-10-31 16:25:42 +00003985 rc = reparentChildPages(pParent);
3986 if( rc!=SQLITE_OK ) goto balance_cleanup;
drh8b2f49b2001-06-08 00:21:52 +00003987
3988 /*
drh3a4c1412004-05-09 20:40:11 +00003989 ** Balance the parent page. Note that the current page (pPage) might
3990 ** have been added to the freelist is it might no longer be initialized.
3991 ** But the parent page will always be initialized.
drh8b2f49b2001-06-08 00:21:52 +00003992 */
drhda200cc2004-05-09 11:51:38 +00003993 assert( pParent->isInit );
drh3a4c1412004-05-09 20:40:11 +00003994 /* assert( pPage->isInit ); // No! pPage might have been added to freelist */
3995 /* pageIntegrity(pPage); // No! pPage might have been added to freelist */
drh4b70f112004-05-02 21:12:19 +00003996 rc = balance(pParent);
drhda200cc2004-05-09 11:51:38 +00003997
drh8b2f49b2001-06-08 00:21:52 +00003998 /*
drh14acc042001-06-10 19:56:58 +00003999 ** Cleanup before returning.
drh8b2f49b2001-06-08 00:21:52 +00004000 */
drh14acc042001-06-10 19:56:58 +00004001balance_cleanup:
drh2e38c322004-09-03 18:38:44 +00004002 sqliteFree(apCell);
drh8b2f49b2001-06-08 00:21:52 +00004003 for(i=0; i<nOld; i++){
drh91025292004-05-03 19:49:32 +00004004 releasePage(apOld[i]);
drh8b2f49b2001-06-08 00:21:52 +00004005 }
drh14acc042001-06-10 19:56:58 +00004006 for(i=0; i<nNew; i++){
drh91025292004-05-03 19:49:32 +00004007 releasePage(apNew[i]);
drh8b2f49b2001-06-08 00:21:52 +00004008 }
drh91025292004-05-03 19:49:32 +00004009 releasePage(pParent);
drh3a4c1412004-05-09 20:40:11 +00004010 TRACE(("BALANCE: finished with %d: old=%d new=%d cells=%d\n",
4011 pPage->pgno, nOld, nNew, nCell));
drh8b2f49b2001-06-08 00:21:52 +00004012 return rc;
4013}
4014
4015/*
drh43605152004-05-29 21:46:49 +00004016** This routine is called for the root page of a btree when the root
4017** page contains no cells. This is an opportunity to make the tree
4018** shallower by one level.
4019*/
4020static int balance_shallower(MemPage *pPage){
4021 MemPage *pChild; /* The only child page of pPage */
4022 Pgno pgnoChild; /* Page number for pChild */
drh2e38c322004-09-03 18:38:44 +00004023 int rc = SQLITE_OK; /* Return code from subprocedures */
4024 Btree *pBt; /* The main BTree structure */
4025 int mxCellPerPage; /* Maximum number of cells per page */
4026 u8 **apCell; /* All cells from pages being balanced */
4027 int *szCell; /* Local size of all cells */
drh43605152004-05-29 21:46:49 +00004028
4029 assert( pPage->pParent==0 );
4030 assert( pPage->nCell==0 );
drh2e38c322004-09-03 18:38:44 +00004031 pBt = pPage->pBt;
4032 mxCellPerPage = MX_CELL(pBt);
4033 apCell = sqliteMallocRaw( mxCellPerPage*(sizeof(u8*)+sizeof(int)) );
4034 if( apCell==0 ) return SQLITE_NOMEM;
4035 szCell = (int*)&apCell[mxCellPerPage];
drh43605152004-05-29 21:46:49 +00004036 if( pPage->leaf ){
4037 /* The table is completely empty */
4038 TRACE(("BALANCE: empty table %d\n", pPage->pgno));
4039 }else{
4040 /* The root page is empty but has one child. Transfer the
4041 ** information from that one child into the root page if it
4042 ** will fit. This reduces the depth of the tree by one.
4043 **
4044 ** If the root page is page 1, it has less space available than
4045 ** its child (due to the 100 byte header that occurs at the beginning
4046 ** of the database fle), so it might not be able to hold all of the
4047 ** information currently contained in the child. If this is the
4048 ** case, then do not do the transfer. Leave page 1 empty except
4049 ** for the right-pointer to the child page. The child page becomes
4050 ** the virtual root of the tree.
4051 */
4052 pgnoChild = get4byte(&pPage->aData[pPage->hdrOffset+8]);
4053 assert( pgnoChild>0 );
4054 assert( pgnoChild<=sqlite3pager_pagecount(pPage->pBt->pPager) );
4055 rc = getPage(pPage->pBt, pgnoChild, &pChild);
drh2e38c322004-09-03 18:38:44 +00004056 if( rc ) goto end_shallow_balance;
drh43605152004-05-29 21:46:49 +00004057 if( pPage->pgno==1 ){
4058 rc = initPage(pChild, pPage);
drh2e38c322004-09-03 18:38:44 +00004059 if( rc ) goto end_shallow_balance;
drh43605152004-05-29 21:46:49 +00004060 assert( pChild->nOverflow==0 );
4061 if( pChild->nFree>=100 ){
4062 /* The child information will fit on the root page, so do the
4063 ** copy */
4064 int i;
4065 zeroPage(pPage, pChild->aData[0]);
4066 for(i=0; i<pChild->nCell; i++){
4067 apCell[i] = findCell(pChild,i);
4068 szCell[i] = cellSizePtr(pChild, apCell[i]);
4069 }
4070 assemblePage(pPage, pChild->nCell, apCell, szCell);
4071 freePage(pChild);
4072 TRACE(("BALANCE: child %d transfer to page 1\n", pChild->pgno));
4073 }else{
4074 /* The child has more information that will fit on the root.
4075 ** The tree is already balanced. Do nothing. */
4076 TRACE(("BALANCE: child %d will not fit on page 1\n", pChild->pgno));
4077 }
4078 }else{
4079 memcpy(pPage->aData, pChild->aData, pPage->pBt->usableSize);
4080 pPage->isInit = 0;
4081 pPage->pParent = 0;
4082 rc = initPage(pPage, 0);
4083 assert( rc==SQLITE_OK );
4084 freePage(pChild);
4085 TRACE(("BALANCE: transfer child %d into root %d\n",
4086 pChild->pgno, pPage->pgno));
4087 }
danielk1977afcdd022004-10-31 16:25:42 +00004088 rc = reparentChildPages(pPage);
4089 if( rc!=SQLITE_OK ) goto end_shallow_balance;
drh43605152004-05-29 21:46:49 +00004090 releasePage(pChild);
4091 }
drh2e38c322004-09-03 18:38:44 +00004092end_shallow_balance:
4093 sqliteFree(apCell);
4094 return rc;
drh43605152004-05-29 21:46:49 +00004095}
4096
4097
4098/*
4099** The root page is overfull
4100**
4101** When this happens, Create a new child page and copy the
4102** contents of the root into the child. Then make the root
4103** page an empty page with rightChild pointing to the new
4104** child. Finally, call balance_internal() on the new child
4105** to cause it to split.
4106*/
4107static int balance_deeper(MemPage *pPage){
4108 int rc; /* Return value from subprocedures */
4109 MemPage *pChild; /* Pointer to a new child page */
4110 Pgno pgnoChild; /* Page number of the new child page */
4111 Btree *pBt; /* The BTree */
4112 int usableSize; /* Total usable size of a page */
4113 u8 *data; /* Content of the parent page */
4114 u8 *cdata; /* Content of the child page */
4115 int hdr; /* Offset to page header in parent */
4116 int brk; /* Offset to content of first cell in parent */
4117
4118 assert( pPage->pParent==0 );
4119 assert( pPage->nOverflow>0 );
4120 pBt = pPage->pBt;
danielk1977cb1a7eb2004-11-05 12:27:02 +00004121 rc = allocatePage(pBt, &pChild, &pgnoChild, pPage->pgno, 0);
drh43605152004-05-29 21:46:49 +00004122 if( rc ) return rc;
4123 assert( sqlite3pager_iswriteable(pChild->aData) );
4124 usableSize = pBt->usableSize;
4125 data = pPage->aData;
4126 hdr = pPage->hdrOffset;
4127 brk = get2byte(&data[hdr+5]);
4128 cdata = pChild->aData;
4129 memcpy(cdata, &data[hdr], pPage->cellOffset+2*pPage->nCell-hdr);
4130 memcpy(&cdata[brk], &data[brk], usableSize-brk);
4131 rc = initPage(pChild, pPage);
4132 if( rc ) return rc;
4133 memcpy(pChild->aOvfl, pPage->aOvfl, pPage->nOverflow*sizeof(pPage->aOvfl[0]));
4134 pChild->nOverflow = pPage->nOverflow;
4135 if( pChild->nOverflow ){
4136 pChild->nFree = 0;
4137 }
4138 assert( pChild->nCell==pPage->nCell );
4139 zeroPage(pPage, pChild->aData[0] & ~PTF_LEAF);
4140 put4byte(&pPage->aData[pPage->hdrOffset+8], pgnoChild);
4141 TRACE(("BALANCE: copy root %d into %d\n", pPage->pgno, pChild->pgno));
4142 rc = balance_nonroot(pChild);
4143 releasePage(pChild);
4144 return rc;
4145}
4146
4147/*
4148** Decide if the page pPage needs to be balanced. If balancing is
4149** required, call the appropriate balancing routine.
4150*/
4151static int balance(MemPage *pPage){
4152 int rc = SQLITE_OK;
4153 if( pPage->pParent==0 ){
4154 if( pPage->nOverflow>0 ){
4155 rc = balance_deeper(pPage);
4156 }
danielk1977687566d2004-11-02 12:56:41 +00004157 if( rc==SQLITE_OK && pPage->nCell==0 ){
drh43605152004-05-29 21:46:49 +00004158 rc = balance_shallower(pPage);
4159 }
4160 }else{
4161 if( pPage->nOverflow>0 || pPage->nFree>pPage->pBt->usableSize*2/3 ){
4162 rc = balance_nonroot(pPage);
4163 }
4164 }
4165 return rc;
4166}
4167
4168/*
drh8dcd7ca2004-08-08 19:43:29 +00004169** This routine checks all cursors that point to table pgnoRoot.
4170** If any of those cursors other than pExclude were opened with
drhf74b8d92002-09-01 23:20:45 +00004171** wrFlag==0 then this routine returns SQLITE_LOCKED. If all
drh8dcd7ca2004-08-08 19:43:29 +00004172** cursors that point to pgnoRoot were opened with wrFlag==1
drhf74b8d92002-09-01 23:20:45 +00004173** then this routine returns SQLITE_OK.
4174**
4175** In addition to checking for read-locks (where a read-lock
4176** means a cursor opened with wrFlag==0) this routine also moves
drh8dcd7ca2004-08-08 19:43:29 +00004177** all cursors other than pExclude so that they are pointing to the
drhf74b8d92002-09-01 23:20:45 +00004178** first Cell on root page. This is necessary because an insert
4179** or delete might change the number of cells on a page or delete
4180** a page entirely and we do not want to leave any cursors
4181** pointing to non-existant pages or cells.
4182*/
drh8dcd7ca2004-08-08 19:43:29 +00004183static int checkReadLocks(Btree *pBt, Pgno pgnoRoot, BtCursor *pExclude){
drhf74b8d92002-09-01 23:20:45 +00004184 BtCursor *p;
drh8dcd7ca2004-08-08 19:43:29 +00004185 for(p=pBt->pCursor; p; p=p->pNext){
4186 if( p->pgnoRoot!=pgnoRoot || p==pExclude ) continue;
drhf74b8d92002-09-01 23:20:45 +00004187 if( p->wrFlag==0 ) return SQLITE_LOCKED;
drh91025292004-05-03 19:49:32 +00004188 if( p->pPage->pgno!=p->pgnoRoot ){
drhf74b8d92002-09-01 23:20:45 +00004189 moveToRoot(p);
4190 }
4191 }
4192 return SQLITE_OK;
4193}
4194
4195/*
drh3b7511c2001-05-26 13:15:44 +00004196** Insert a new record into the BTree. The key is given by (pKey,nKey)
4197** and the data is given by (pData,nData). The cursor is used only to
drh91025292004-05-03 19:49:32 +00004198** define what table the record should be inserted into. The cursor
drh4b70f112004-05-02 21:12:19 +00004199** is left pointing at a random location.
4200**
4201** For an INTKEY table, only the nKey value of the key is used. pKey is
4202** ignored. For a ZERODATA table, the pData and nData are both ignored.
drh3b7511c2001-05-26 13:15:44 +00004203*/
drh3aac2dd2004-04-26 14:10:20 +00004204int sqlite3BtreeInsert(
drh5c4d9702001-08-20 00:33:58 +00004205 BtCursor *pCur, /* Insert data into the table of this cursor */
drh4a1c3802004-05-12 15:15:47 +00004206 const void *pKey, i64 nKey, /* The key of the new record */
drh5c4d9702001-08-20 00:33:58 +00004207 const void *pData, int nData /* The data of the new record */
drh3b7511c2001-05-26 13:15:44 +00004208){
drh3b7511c2001-05-26 13:15:44 +00004209 int rc;
4210 int loc;
drh14acc042001-06-10 19:56:58 +00004211 int szNew;
drh3b7511c2001-05-26 13:15:44 +00004212 MemPage *pPage;
4213 Btree *pBt = pCur->pBt;
drha34b6762004-05-07 13:30:42 +00004214 unsigned char *oldCell;
drh2e38c322004-09-03 18:38:44 +00004215 unsigned char *newCell = 0;
drh3b7511c2001-05-26 13:15:44 +00004216
drhc39e0002004-05-07 23:50:57 +00004217 if( pCur->status ){
4218 return pCur->status; /* A rollback destroyed this cursor */
drhecdc7532001-09-23 02:35:53 +00004219 }
danielk1977ee5741e2004-05-31 10:01:34 +00004220 if( pBt->inTrans!=TRANS_WRITE ){
drhf74b8d92002-09-01 23:20:45 +00004221 /* Must start a transaction before doing an insert */
4222 return pBt->readOnly ? SQLITE_READONLY : SQLITE_ERROR;
drh8b2f49b2001-06-08 00:21:52 +00004223 }
drhf74b8d92002-09-01 23:20:45 +00004224 assert( !pBt->readOnly );
drhecdc7532001-09-23 02:35:53 +00004225 if( !pCur->wrFlag ){
4226 return SQLITE_PERM; /* Cursor not open for writing */
4227 }
drh8dcd7ca2004-08-08 19:43:29 +00004228 if( checkReadLocks(pBt, pCur->pgnoRoot, pCur) ){
drhf74b8d92002-09-01 23:20:45 +00004229 return SQLITE_LOCKED; /* The table pCur points to has a read lock */
4230 }
drh3aac2dd2004-04-26 14:10:20 +00004231 rc = sqlite3BtreeMoveto(pCur, pKey, nKey, &loc);
drh3b7511c2001-05-26 13:15:44 +00004232 if( rc ) return rc;
drh14acc042001-06-10 19:56:58 +00004233 pPage = pCur->pPage;
drh4a1c3802004-05-12 15:15:47 +00004234 assert( pPage->intKey || nKey>=0 );
drh8b18dd42004-05-12 19:18:15 +00004235 assert( pPage->leaf || !pPage->leafData );
drh3a4c1412004-05-09 20:40:11 +00004236 TRACE(("INSERT: table=%d nkey=%lld ndata=%d page=%d %s\n",
4237 pCur->pgnoRoot, nKey, nData, pPage->pgno,
4238 loc==0 ? "overwrite" : "new entry"));
drh7aa128d2002-06-21 13:09:16 +00004239 assert( pPage->isInit );
drha34b6762004-05-07 13:30:42 +00004240 rc = sqlite3pager_write(pPage->aData);
drhbd03cae2001-06-02 02:40:57 +00004241 if( rc ) return rc;
drh2e38c322004-09-03 18:38:44 +00004242 newCell = sqliteMallocRaw( MX_CELL_SIZE(pBt) );
4243 if( newCell==0 ) return SQLITE_NOMEM;
drha34b6762004-05-07 13:30:42 +00004244 rc = fillInCell(pPage, newCell, pKey, nKey, pData, nData, &szNew);
drh2e38c322004-09-03 18:38:44 +00004245 if( rc ) goto end_insert;
drh43605152004-05-29 21:46:49 +00004246 assert( szNew==cellSizePtr(pPage, newCell) );
drh2e38c322004-09-03 18:38:44 +00004247 assert( szNew<=MX_CELL_SIZE(pBt) );
drhf328bc82004-05-10 23:29:49 +00004248 if( loc==0 && pCur->isValid ){
drha34b6762004-05-07 13:30:42 +00004249 int szOld;
4250 assert( pCur->idx>=0 && pCur->idx<pPage->nCell );
drh43605152004-05-29 21:46:49 +00004251 oldCell = findCell(pPage, pCur->idx);
drh4b70f112004-05-02 21:12:19 +00004252 if( !pPage->leaf ){
drh43605152004-05-29 21:46:49 +00004253 memcpy(newCell, oldCell, 4);
drh4b70f112004-05-02 21:12:19 +00004254 }
drh43605152004-05-29 21:46:49 +00004255 szOld = cellSizePtr(pPage, oldCell);
drh4b70f112004-05-02 21:12:19 +00004256 rc = clearCell(pPage, oldCell);
drh2e38c322004-09-03 18:38:44 +00004257 if( rc ) goto end_insert;
drh4b70f112004-05-02 21:12:19 +00004258 dropCell(pPage, pCur->idx, szOld);
drh7c717f72001-06-24 20:39:41 +00004259 }else if( loc<0 && pPage->nCell>0 ){
drh4b70f112004-05-02 21:12:19 +00004260 assert( pPage->leaf );
drh14acc042001-06-10 19:56:58 +00004261 pCur->idx++;
drh271efa52004-05-30 19:19:05 +00004262 pCur->info.nSize = 0;
drh14acc042001-06-10 19:56:58 +00004263 }else{
drh4b70f112004-05-02 21:12:19 +00004264 assert( pPage->leaf );
drh3b7511c2001-05-26 13:15:44 +00004265 }
danielk1977e80463b2004-11-03 03:01:16 +00004266 rc = insertCell(pPage, pCur->idx, newCell, szNew, 0);
4267 if( rc!=SQLITE_OK ) goto end_insert;
drh4b70f112004-05-02 21:12:19 +00004268 rc = balance(pPage);
drh23e11ca2004-05-04 17:27:28 +00004269 /* sqlite3BtreePageDump(pCur->pBt, pCur->pgnoRoot, 1); */
drh3fc190c2001-09-14 03:24:23 +00004270 /* fflush(stdout); */
danielk1977687566d2004-11-02 12:56:41 +00004271 if( rc==SQLITE_OK ){
4272 moveToRoot(pCur);
4273 }
drh2e38c322004-09-03 18:38:44 +00004274end_insert:
4275 sqliteFree(newCell);
drh5e2f8b92001-05-28 00:41:15 +00004276 return rc;
4277}
4278
4279/*
drh4b70f112004-05-02 21:12:19 +00004280** Delete the entry that the cursor is pointing to. The cursor
4281** is left pointing at a random location.
drh3b7511c2001-05-26 13:15:44 +00004282*/
drh3aac2dd2004-04-26 14:10:20 +00004283int sqlite3BtreeDelete(BtCursor *pCur){
drh5e2f8b92001-05-28 00:41:15 +00004284 MemPage *pPage = pCur->pPage;
drh4b70f112004-05-02 21:12:19 +00004285 unsigned char *pCell;
drh5e2f8b92001-05-28 00:41:15 +00004286 int rc;
danielk1977cfe9a692004-06-16 12:00:29 +00004287 Pgno pgnoChild = 0;
drh0d316a42002-08-11 20:10:47 +00004288 Btree *pBt = pCur->pBt;
drh8b2f49b2001-06-08 00:21:52 +00004289
drh7aa128d2002-06-21 13:09:16 +00004290 assert( pPage->isInit );
drhc39e0002004-05-07 23:50:57 +00004291 if( pCur->status ){
4292 return pCur->status; /* A rollback destroyed this cursor */
drhecdc7532001-09-23 02:35:53 +00004293 }
danielk1977ee5741e2004-05-31 10:01:34 +00004294 if( pBt->inTrans!=TRANS_WRITE ){
drhf74b8d92002-09-01 23:20:45 +00004295 /* Must start a transaction before doing a delete */
4296 return pBt->readOnly ? SQLITE_READONLY : SQLITE_ERROR;
drh8b2f49b2001-06-08 00:21:52 +00004297 }
drhf74b8d92002-09-01 23:20:45 +00004298 assert( !pBt->readOnly );
drhbd03cae2001-06-02 02:40:57 +00004299 if( pCur->idx >= pPage->nCell ){
4300 return SQLITE_ERROR; /* The cursor is not pointing to anything */
4301 }
drhecdc7532001-09-23 02:35:53 +00004302 if( !pCur->wrFlag ){
4303 return SQLITE_PERM; /* Did not open this cursor for writing */
4304 }
drh8dcd7ca2004-08-08 19:43:29 +00004305 if( checkReadLocks(pBt, pCur->pgnoRoot, pCur) ){
drhf74b8d92002-09-01 23:20:45 +00004306 return SQLITE_LOCKED; /* The table pCur points to has a read lock */
4307 }
drha34b6762004-05-07 13:30:42 +00004308 rc = sqlite3pager_write(pPage->aData);
drhbd03cae2001-06-02 02:40:57 +00004309 if( rc ) return rc;
drh43605152004-05-29 21:46:49 +00004310 pCell = findCell(pPage, pCur->idx);
drh4b70f112004-05-02 21:12:19 +00004311 if( !pPage->leaf ){
drh43605152004-05-29 21:46:49 +00004312 pgnoChild = get4byte(pCell);
drh4b70f112004-05-02 21:12:19 +00004313 }
4314 clearCell(pPage, pCell);
4315 if( !pPage->leaf ){
drh14acc042001-06-10 19:56:58 +00004316 /*
drh5e00f6c2001-09-13 13:46:56 +00004317 ** The entry we are about to delete is not a leaf so if we do not
drh9ca7d3b2001-06-28 11:50:21 +00004318 ** do something we will leave a hole on an internal page.
4319 ** We have to fill the hole by moving in a cell from a leaf. The
4320 ** next Cell after the one to be deleted is guaranteed to exist and
4321 ** to be a leaf so we can use it.
drh5e2f8b92001-05-28 00:41:15 +00004322 */
drh14acc042001-06-10 19:56:58 +00004323 BtCursor leafCur;
drh4b70f112004-05-02 21:12:19 +00004324 unsigned char *pNext;
drh14acc042001-06-10 19:56:58 +00004325 int szNext;
drh8c1238a2003-01-02 14:43:55 +00004326 int notUsed;
drh2e38c322004-09-03 18:38:44 +00004327 unsigned char *tempCell;
drh8b18dd42004-05-12 19:18:15 +00004328 assert( !pPage->leafData );
drh14acc042001-06-10 19:56:58 +00004329 getTempCursor(pCur, &leafCur);
drh3aac2dd2004-04-26 14:10:20 +00004330 rc = sqlite3BtreeNext(&leafCur, &notUsed);
drh14acc042001-06-10 19:56:58 +00004331 if( rc!=SQLITE_OK ){
drhee696e22004-08-30 16:52:17 +00004332 if( rc!=SQLITE_NOMEM ){
4333 rc = SQLITE_CORRUPT; /* bkpt-CORRUPT */
4334 }
drh8a6ac0a2004-02-14 17:35:07 +00004335 return rc;
drh5e2f8b92001-05-28 00:41:15 +00004336 }
drha34b6762004-05-07 13:30:42 +00004337 rc = sqlite3pager_write(leafCur.pPage->aData);
drh6019e162001-07-02 17:51:45 +00004338 if( rc ) return rc;
drh3a4c1412004-05-09 20:40:11 +00004339 TRACE(("DELETE: table=%d delete internal from %d replace from leaf %d\n",
4340 pCur->pgnoRoot, pPage->pgno, leafCur.pPage->pgno));
drh43605152004-05-29 21:46:49 +00004341 dropCell(pPage, pCur->idx, cellSizePtr(pPage, pCell));
4342 pNext = findCell(leafCur.pPage, leafCur.idx);
4343 szNext = cellSizePtr(leafCur.pPage, pNext);
drh2e38c322004-09-03 18:38:44 +00004344 assert( MX_CELL_SIZE(pBt)>=szNext+4 );
4345 tempCell = sqliteMallocRaw( MX_CELL_SIZE(pBt) );
4346 if( tempCell==0 ) return SQLITE_NOMEM;
danielk1977e80463b2004-11-03 03:01:16 +00004347 rc = insertCell(pPage, pCur->idx, pNext-4, szNext+4, tempCell);
4348 if( rc!=SQLITE_OK ) return rc;
drh43605152004-05-29 21:46:49 +00004349 put4byte(findOverflowCell(pPage, pCur->idx), pgnoChild);
drh4b70f112004-05-02 21:12:19 +00004350 rc = balance(pPage);
drh2e38c322004-09-03 18:38:44 +00004351 sqliteFree(tempCell);
drh5e2f8b92001-05-28 00:41:15 +00004352 if( rc ) return rc;
drh4b70f112004-05-02 21:12:19 +00004353 dropCell(leafCur.pPage, leafCur.idx, szNext);
4354 rc = balance(leafCur.pPage);
drh8c42ca92001-06-22 19:15:00 +00004355 releaseTempCursor(&leafCur);
drh5e2f8b92001-05-28 00:41:15 +00004356 }else{
drh3a4c1412004-05-09 20:40:11 +00004357 TRACE(("DELETE: table=%d delete from leaf %d\n",
4358 pCur->pgnoRoot, pPage->pgno));
drh43605152004-05-29 21:46:49 +00004359 dropCell(pPage, pCur->idx, cellSizePtr(pPage, pCell));
drh4b70f112004-05-02 21:12:19 +00004360 rc = balance(pPage);
drh5e2f8b92001-05-28 00:41:15 +00004361 }
drh4b70f112004-05-02 21:12:19 +00004362 moveToRoot(pCur);
drh5e2f8b92001-05-28 00:41:15 +00004363 return rc;
drh3b7511c2001-05-26 13:15:44 +00004364}
drh8b2f49b2001-06-08 00:21:52 +00004365
4366/*
drhc6b52df2002-01-04 03:09:29 +00004367** Create a new BTree table. Write into *piTable the page
4368** number for the root page of the new table.
4369**
drhab01f612004-05-22 02:55:23 +00004370** The type of type is determined by the flags parameter. Only the
4371** following values of flags are currently in use. Other values for
4372** flags might not work:
4373**
4374** BTREE_INTKEY|BTREE_LEAFDATA Used for SQL tables with rowid keys
4375** BTREE_ZERODATA Used for SQL indices
drh8b2f49b2001-06-08 00:21:52 +00004376*/
drh3aac2dd2004-04-26 14:10:20 +00004377int sqlite3BtreeCreateTable(Btree *pBt, int *piTable, int flags){
drh8b2f49b2001-06-08 00:21:52 +00004378 MemPage *pRoot;
4379 Pgno pgnoRoot;
4380 int rc;
danielk1977003ba062004-11-04 02:57:33 +00004381/* TODO: Disallow schema modifications if there are open cursors */
danielk1977ee5741e2004-05-31 10:01:34 +00004382 if( pBt->inTrans!=TRANS_WRITE ){
drhf74b8d92002-09-01 23:20:45 +00004383 /* Must start a transaction first */
4384 return pBt->readOnly ? SQLITE_READONLY : SQLITE_ERROR;
drh8b2f49b2001-06-08 00:21:52 +00004385 }
drh5df72a52002-06-06 23:16:05 +00004386 if( pBt->readOnly ){
4387 return SQLITE_READONLY;
4388 }
danielk1977003ba062004-11-04 02:57:33 +00004389#ifdef SQLITE_OMIT_AUTOVACUUM
danielk1977cb1a7eb2004-11-05 12:27:02 +00004390 rc = allocatePage(pBt, &pRoot, &pgnoRoot, 1, 0);
drh8b2f49b2001-06-08 00:21:52 +00004391 if( rc ) return rc;
danielk1977003ba062004-11-04 02:57:33 +00004392#else
danielk1977687566d2004-11-02 12:56:41 +00004393 if( pBt->autoVacuum ){
danielk1977003ba062004-11-04 02:57:33 +00004394 Pgno pgnoMove; /* Move a page here to make room for the root-page */
4395 MemPage *pPageMove; /* The page to move to. */
4396
danielk1977003ba062004-11-04 02:57:33 +00004397 /* Read the value of meta[3] from the database to determine where the
4398 ** root page of the new table should go. meta[3] is the largest root-page
4399 ** created so far, so the new root-page is (meta[3]+1).
4400 */
4401 rc = sqlite3BtreeGetMeta(pBt, 4, &pgnoRoot);
4402 if( rc!=SQLITE_OK ) return rc;
4403 pgnoRoot++;
4404
danielk1977599fcba2004-11-08 07:13:13 +00004405 /* The new root-page may not be allocated on a pointer-map page, or the
4406 ** PENDING_BYTE page.
4407 */
4408 if( pgnoRoot==PTRMAP_PAGENO(pBt->pageSize, pgnoRoot) ||
4409 pgnoRoot==PENDING_BYTE_PAGE(pBt) ){
danielk1977003ba062004-11-04 02:57:33 +00004410 pgnoRoot++;
4411 }
4412 assert( pgnoRoot>=3 );
4413
4414 /* Allocate a page. The page that currently resides at pgnoRoot will
4415 ** be moved to the allocated page (unless the allocated page happens
4416 ** to reside at pgnoRoot).
4417 */
danielk1977cb1a7eb2004-11-05 12:27:02 +00004418 rc = allocatePage(pBt, &pPageMove, &pgnoMove, pgnoRoot, 1);
danielk1977003ba062004-11-04 02:57:33 +00004419 if( rc!=SQLITE_OK ){
danielk1977687566d2004-11-02 12:56:41 +00004420 return rc;
4421 }
danielk1977003ba062004-11-04 02:57:33 +00004422
4423 if( pgnoMove!=pgnoRoot ){
4424 u8 eType;
4425 Pgno iPtrPage;
4426
4427 releasePage(pPageMove);
4428 rc = getPage(pBt, pgnoRoot, &pRoot);
4429 if( rc!=SQLITE_OK ){
4430 return rc;
4431 }
4432 rc = ptrmapGet(pBt, pgnoRoot, &eType, &iPtrPage);
danielk1977a0bf2652004-11-04 14:30:04 +00004433 assert( eType!=PTRMAP_ROOTPAGE );
danielk1977a64a0352004-11-05 01:45:13 +00004434 assert( eType!=PTRMAP_FREEPAGE );
danielk1977003ba062004-11-04 02:57:33 +00004435 if( rc!=SQLITE_OK ){
4436 releasePage(pRoot);
4437 return rc;
4438 }
4439 rc = relocatePage(pBt, pRoot, eType, iPtrPage, pgnoMove);
4440 releasePage(pRoot);
4441 if( rc!=SQLITE_OK ){
4442 return rc;
4443 }
4444 rc = getPage(pBt, pgnoRoot, &pRoot);
4445 if( rc!=SQLITE_OK ){
4446 return rc;
4447 }
4448 rc = sqlite3pager_write(pRoot->aData);
4449 if( rc!=SQLITE_OK ){
4450 releasePage(pRoot);
4451 return rc;
4452 }
4453 }else{
4454 pRoot = pPageMove;
4455 }
4456
4457 rc = ptrmapPut(pBt, pgnoRoot, PTRMAP_ROOTPAGE, 0);
4458 if( rc ){
4459 releasePage(pRoot);
4460 return rc;
4461 }
4462 rc = sqlite3BtreeUpdateMeta(pBt, 4, pgnoRoot);
4463 if( rc ){
4464 releasePage(pRoot);
4465 return rc;
4466 }
4467 }else{
danielk1977cb1a7eb2004-11-05 12:27:02 +00004468 rc = allocatePage(pBt, &pRoot, &pgnoRoot, 1, 0);
danielk1977003ba062004-11-04 02:57:33 +00004469 if( rc ) return rc;
danielk1977687566d2004-11-02 12:56:41 +00004470 }
4471#endif
drha34b6762004-05-07 13:30:42 +00004472 assert( sqlite3pager_iswriteable(pRoot->aData) );
drhde647132004-05-07 17:57:49 +00004473 zeroPage(pRoot, flags | PTF_LEAF);
drha34b6762004-05-07 13:30:42 +00004474 sqlite3pager_unref(pRoot->aData);
drh8b2f49b2001-06-08 00:21:52 +00004475 *piTable = (int)pgnoRoot;
4476 return SQLITE_OK;
4477}
4478
4479/*
4480** Erase the given database page and all its children. Return
4481** the page to the freelist.
4482*/
drh4b70f112004-05-02 21:12:19 +00004483static int clearDatabasePage(
4484 Btree *pBt, /* The BTree that contains the table */
4485 Pgno pgno, /* Page number to clear */
4486 MemPage *pParent, /* Parent page. NULL for the root */
4487 int freePageFlag /* Deallocate page if true */
4488){
drh8b2f49b2001-06-08 00:21:52 +00004489 MemPage *pPage;
4490 int rc;
drh4b70f112004-05-02 21:12:19 +00004491 unsigned char *pCell;
4492 int i;
drh8b2f49b2001-06-08 00:21:52 +00004493
drhde647132004-05-07 17:57:49 +00004494 rc = getAndInitPage(pBt, pgno, &pPage, pParent);
drh8b2f49b2001-06-08 00:21:52 +00004495 if( rc ) return rc;
drha34b6762004-05-07 13:30:42 +00004496 rc = sqlite3pager_write(pPage->aData);
drh6019e162001-07-02 17:51:45 +00004497 if( rc ) return rc;
drh4b70f112004-05-02 21:12:19 +00004498 for(i=0; i<pPage->nCell; i++){
drh43605152004-05-29 21:46:49 +00004499 pCell = findCell(pPage, i);
drh4b70f112004-05-02 21:12:19 +00004500 if( !pPage->leaf ){
drh43605152004-05-29 21:46:49 +00004501 rc = clearDatabasePage(pBt, get4byte(pCell), pPage->pParent, 1);
drh8b2f49b2001-06-08 00:21:52 +00004502 if( rc ) return rc;
4503 }
drh4b70f112004-05-02 21:12:19 +00004504 rc = clearCell(pPage, pCell);
drh8b2f49b2001-06-08 00:21:52 +00004505 if( rc ) return rc;
4506 }
drha34b6762004-05-07 13:30:42 +00004507 if( !pPage->leaf ){
drh43605152004-05-29 21:46:49 +00004508 rc = clearDatabasePage(pBt, get4byte(&pPage->aData[8]), pPage->pParent, 1);
drh2aa679f2001-06-25 02:11:07 +00004509 if( rc ) return rc;
4510 }
4511 if( freePageFlag ){
drh4b70f112004-05-02 21:12:19 +00004512 rc = freePage(pPage);
drh2aa679f2001-06-25 02:11:07 +00004513 }else{
drh3a4c1412004-05-09 20:40:11 +00004514 zeroPage(pPage, pPage->aData[0] | PTF_LEAF);
drh2aa679f2001-06-25 02:11:07 +00004515 }
drh4b70f112004-05-02 21:12:19 +00004516 releasePage(pPage);
drh2aa679f2001-06-25 02:11:07 +00004517 return rc;
drh8b2f49b2001-06-08 00:21:52 +00004518}
4519
4520/*
drhab01f612004-05-22 02:55:23 +00004521** Delete all information from a single table in the database. iTable is
4522** the page number of the root of the table. After this routine returns,
4523** the root page is empty, but still exists.
4524**
4525** This routine will fail with SQLITE_LOCKED if there are any open
4526** read cursors on the table. Open write cursors are moved to the
4527** root of the table.
drh8b2f49b2001-06-08 00:21:52 +00004528*/
drh3aac2dd2004-04-26 14:10:20 +00004529int sqlite3BtreeClearTable(Btree *pBt, int iTable){
drh8b2f49b2001-06-08 00:21:52 +00004530 int rc;
drhf74b8d92002-09-01 23:20:45 +00004531 BtCursor *pCur;
danielk1977ee5741e2004-05-31 10:01:34 +00004532 if( pBt->inTrans!=TRANS_WRITE ){
drhf74b8d92002-09-01 23:20:45 +00004533 return pBt->readOnly ? SQLITE_READONLY : SQLITE_ERROR;
drh8b2f49b2001-06-08 00:21:52 +00004534 }
drhf74b8d92002-09-01 23:20:45 +00004535 for(pCur=pBt->pCursor; pCur; pCur=pCur->pNext){
4536 if( pCur->pgnoRoot==(Pgno)iTable ){
4537 if( pCur->wrFlag==0 ) return SQLITE_LOCKED;
4538 moveToRoot(pCur);
4539 }
drhecdc7532001-09-23 02:35:53 +00004540 }
drha34b6762004-05-07 13:30:42 +00004541 rc = clearDatabasePage(pBt, (Pgno)iTable, 0, 0);
drh8b2f49b2001-06-08 00:21:52 +00004542 if( rc ){
drh3aac2dd2004-04-26 14:10:20 +00004543 sqlite3BtreeRollback(pBt);
drh8b2f49b2001-06-08 00:21:52 +00004544 }
drh8c42ca92001-06-22 19:15:00 +00004545 return rc;
drh8b2f49b2001-06-08 00:21:52 +00004546}
4547
4548/*
4549** Erase all information in a table and add the root of the table to
4550** the freelist. Except, the root of the principle table (the one on
drhab01f612004-05-22 02:55:23 +00004551** page 1) is never added to the freelist.
4552**
4553** This routine will fail with SQLITE_LOCKED if there are any open
4554** cursors on the table.
drh205f48e2004-11-05 00:43:11 +00004555**
4556** If AUTOVACUUM is enabled and the page at iTable is not the last
4557** root page in the database file, then the last root page
4558** in the database file is moved into the slot formerly occupied by
4559** iTable and that last slot formerly occupied by the last root page
4560** is added to the freelist instead of iTable. In this say, all
4561** root pages are kept at the beginning of the database file, which
4562** is necessary for AUTOVACUUM to work right. *piMoved is set to the
4563** page number that used to be the last root page in the file before
4564** the move. If no page gets moved, *piMoved is set to 0.
4565** The last root page is recorded in meta[3] and the value of
4566** meta[3] is updated by this procedure.
drh8b2f49b2001-06-08 00:21:52 +00004567*/
danielk1977a0bf2652004-11-04 14:30:04 +00004568int sqlite3BtreeDropTable(Btree *pBt, int iTable, int *piMoved){
drh8b2f49b2001-06-08 00:21:52 +00004569 int rc;
danielk1977a0bf2652004-11-04 14:30:04 +00004570 MemPage *pPage = 0;
drhf74b8d92002-09-01 23:20:45 +00004571 BtCursor *pCur;
danielk1977a0bf2652004-11-04 14:30:04 +00004572
danielk1977ee5741e2004-05-31 10:01:34 +00004573 if( pBt->inTrans!=TRANS_WRITE ){
drhf74b8d92002-09-01 23:20:45 +00004574 return pBt->readOnly ? SQLITE_READONLY : SQLITE_ERROR;
drh8b2f49b2001-06-08 00:21:52 +00004575 }
danielk1977a0bf2652004-11-04 14:30:04 +00004576
4577/* TODO: Disallow schema modifications if there are open cursors */
drhf74b8d92002-09-01 23:20:45 +00004578 for(pCur=pBt->pCursor; pCur; pCur=pCur->pNext){
4579 if( pCur->pgnoRoot==(Pgno)iTable ){
4580 return SQLITE_LOCKED; /* Cannot drop a table that has a cursor */
4581 }
drh5df72a52002-06-06 23:16:05 +00004582 }
danielk1977a0bf2652004-11-04 14:30:04 +00004583
drha34b6762004-05-07 13:30:42 +00004584 rc = getPage(pBt, (Pgno)iTable, &pPage);
drh2aa679f2001-06-25 02:11:07 +00004585 if( rc ) return rc;
drh3aac2dd2004-04-26 14:10:20 +00004586 rc = sqlite3BtreeClearTable(pBt, iTable);
drh2aa679f2001-06-25 02:11:07 +00004587 if( rc ) return rc;
danielk1977a0bf2652004-11-04 14:30:04 +00004588
drh205f48e2004-11-05 00:43:11 +00004589 *piMoved = 0;
danielk1977a0bf2652004-11-04 14:30:04 +00004590
drh4b70f112004-05-02 21:12:19 +00004591 if( iTable>1 ){
danielk1977a0bf2652004-11-04 14:30:04 +00004592#ifdef SQLITE_OMIT_AUTOVACUUM
drha34b6762004-05-07 13:30:42 +00004593 rc = freePage(pPage);
danielk1977a0bf2652004-11-04 14:30:04 +00004594 releasePage(pPage);
4595#else
4596 if( pBt->autoVacuum ){
4597 Pgno maxRootPgno;
4598 rc = sqlite3BtreeGetMeta(pBt, 4, &maxRootPgno);
4599 if( rc!=SQLITE_OK ){
4600 releasePage(pPage);
4601 return rc;
4602 }
4603
4604 if( iTable==maxRootPgno ){
4605 /* If the table being dropped is the table with the largest root-page
4606 ** number in the database, put the root page on the free list.
4607 */
4608 rc = freePage(pPage);
4609 releasePage(pPage);
4610 if( rc!=SQLITE_OK ){
4611 return rc;
4612 }
4613 }else{
4614 /* The table being dropped does not have the largest root-page
4615 ** number in the database. So move the page that does into the
4616 ** gap left by the deleted root-page.
4617 */
4618 MemPage *pMove;
4619 releasePage(pPage);
4620 rc = getPage(pBt, maxRootPgno, &pMove);
4621 if( rc!=SQLITE_OK ){
4622 return rc;
4623 }
4624 rc = relocatePage(pBt, pMove, PTRMAP_ROOTPAGE, 0, iTable);
4625 releasePage(pMove);
4626 if( rc!=SQLITE_OK ){
4627 return rc;
4628 }
4629 rc = getPage(pBt, maxRootPgno, &pMove);
4630 if( rc!=SQLITE_OK ){
4631 return rc;
4632 }
4633 rc = freePage(pMove);
4634 releasePage(pMove);
4635 if( rc!=SQLITE_OK ){
4636 return rc;
4637 }
4638 *piMoved = maxRootPgno;
4639 }
4640
danielk1977599fcba2004-11-08 07:13:13 +00004641 /* Set the new 'max-root-page' value in the database header. This
4642 ** is the old value less one, less one more if that happens to
4643 ** be a root-page number, less one again if that is the
4644 ** PENDING_BYTE_PAGE.
4645 */
danielk197787a6e732004-11-05 12:58:25 +00004646 maxRootPgno--;
danielk1977599fcba2004-11-08 07:13:13 +00004647 if( maxRootPgno==PENDING_BYTE_PAGE(pBt) ){
4648 maxRootPgno--;
4649 }
danielk197787a6e732004-11-05 12:58:25 +00004650 if( maxRootPgno==PTRMAP_PAGENO(pBt->pageSize, maxRootPgno) ){
4651 maxRootPgno--;
4652 }
danielk1977599fcba2004-11-08 07:13:13 +00004653 assert( maxRootPgno!=PENDING_BYTE_PAGE(pBt) );
4654
danielk197787a6e732004-11-05 12:58:25 +00004655 rc = sqlite3BtreeUpdateMeta(pBt, 4, maxRootPgno);
danielk1977a0bf2652004-11-04 14:30:04 +00004656 }else{
4657 rc = freePage(pPage);
4658 releasePage(pPage);
4659 }
4660#endif
drh2aa679f2001-06-25 02:11:07 +00004661 }else{
danielk1977a0bf2652004-11-04 14:30:04 +00004662 /* If sqlite3BtreeDropTable was called on page 1. */
drha34b6762004-05-07 13:30:42 +00004663 zeroPage(pPage, PTF_INTKEY|PTF_LEAF );
danielk1977a0bf2652004-11-04 14:30:04 +00004664 releasePage(pPage);
drh8b2f49b2001-06-08 00:21:52 +00004665 }
drh8b2f49b2001-06-08 00:21:52 +00004666 return rc;
4667}
4668
drh001bbcb2003-03-19 03:14:00 +00004669
drh8b2f49b2001-06-08 00:21:52 +00004670/*
drh23e11ca2004-05-04 17:27:28 +00004671** Read the meta-information out of a database file. Meta[0]
4672** is the number of free pages currently in the database. Meta[1]
drha3b321d2004-05-11 09:31:31 +00004673** through meta[15] are available for use by higher layers. Meta[0]
4674** is read-only, the others are read/write.
4675**
4676** The schema layer numbers meta values differently. At the schema
4677** layer (and the SetCookie and ReadCookie opcodes) the number of
4678** free pages is not visible. So Cookie[0] is the same as Meta[1].
drh8b2f49b2001-06-08 00:21:52 +00004679*/
drh3aac2dd2004-04-26 14:10:20 +00004680int sqlite3BtreeGetMeta(Btree *pBt, int idx, u32 *pMeta){
drh8b2f49b2001-06-08 00:21:52 +00004681 int rc;
drh4b70f112004-05-02 21:12:19 +00004682 unsigned char *pP1;
drh8b2f49b2001-06-08 00:21:52 +00004683
drh23e11ca2004-05-04 17:27:28 +00004684 assert( idx>=0 && idx<=15 );
drha34b6762004-05-07 13:30:42 +00004685 rc = sqlite3pager_get(pBt->pPager, 1, (void**)&pP1);
drh8b2f49b2001-06-08 00:21:52 +00004686 if( rc ) return rc;
drh23e11ca2004-05-04 17:27:28 +00004687 *pMeta = get4byte(&pP1[36 + idx*4]);
drha34b6762004-05-07 13:30:42 +00004688 sqlite3pager_unref(pP1);
drhae157872004-08-14 19:20:09 +00004689
danielk1977599fcba2004-11-08 07:13:13 +00004690 /* If autovacuumed is disabled in this build but we are trying to
4691 ** access an autovacuumed database, then make the database readonly.
4692 */
danielk1977003ba062004-11-04 02:57:33 +00004693#ifdef SQLITE_OMIT_AUTOVACUUM
drhae157872004-08-14 19:20:09 +00004694 if( idx==4 && *pMeta>0 ) pBt->readOnly = 1;
danielk1977003ba062004-11-04 02:57:33 +00004695#endif
drhae157872004-08-14 19:20:09 +00004696
drh8b2f49b2001-06-08 00:21:52 +00004697 return SQLITE_OK;
4698}
4699
4700/*
drh23e11ca2004-05-04 17:27:28 +00004701** Write meta-information back into the database. Meta[0] is
4702** read-only and may not be written.
drh8b2f49b2001-06-08 00:21:52 +00004703*/
drh3aac2dd2004-04-26 14:10:20 +00004704int sqlite3BtreeUpdateMeta(Btree *pBt, int idx, u32 iMeta){
drh4b70f112004-05-02 21:12:19 +00004705 unsigned char *pP1;
drha34b6762004-05-07 13:30:42 +00004706 int rc;
drh23e11ca2004-05-04 17:27:28 +00004707 assert( idx>=1 && idx<=15 );
danielk1977ee5741e2004-05-31 10:01:34 +00004708 if( pBt->inTrans!=TRANS_WRITE ){
drhf74b8d92002-09-01 23:20:45 +00004709 return pBt->readOnly ? SQLITE_READONLY : SQLITE_ERROR;
drh5df72a52002-06-06 23:16:05 +00004710 }
drhde647132004-05-07 17:57:49 +00004711 assert( pBt->pPage1!=0 );
4712 pP1 = pBt->pPage1->aData;
drha34b6762004-05-07 13:30:42 +00004713 rc = sqlite3pager_write(pP1);
drh4b70f112004-05-02 21:12:19 +00004714 if( rc ) return rc;
drh23e11ca2004-05-04 17:27:28 +00004715 put4byte(&pP1[36 + idx*4], iMeta);
drh8b2f49b2001-06-08 00:21:52 +00004716 return SQLITE_OK;
4717}
drh8c42ca92001-06-22 19:15:00 +00004718
drhf328bc82004-05-10 23:29:49 +00004719/*
4720** Return the flag byte at the beginning of the page that the cursor
4721** is currently pointing to.
4722*/
4723int sqlite3BtreeFlags(BtCursor *pCur){
4724 MemPage *pPage = pCur->pPage;
4725 return pPage ? pPage->aData[pPage->hdrOffset] : 0;
4726}
4727
drh8c42ca92001-06-22 19:15:00 +00004728/*
4729** Print a disassembly of the given page on standard output. This routine
4730** is used for debugging and testing only.
4731*/
drhaaab5722002-02-19 13:39:21 +00004732#ifdef SQLITE_TEST
drh23e11ca2004-05-04 17:27:28 +00004733int sqlite3BtreePageDump(Btree *pBt, int pgno, int recursive){
drh8c42ca92001-06-22 19:15:00 +00004734 int rc;
4735 MemPage *pPage;
drhc8629a12004-05-08 20:07:40 +00004736 int i, j, c;
drh8c42ca92001-06-22 19:15:00 +00004737 int nFree;
4738 u16 idx;
drhab9f7f12004-05-08 10:56:11 +00004739 int hdr;
drh43605152004-05-29 21:46:49 +00004740 int nCell;
drha2fce642004-06-05 00:01:44 +00004741 int isInit;
drhab9f7f12004-05-08 10:56:11 +00004742 unsigned char *data;
drh8c42ca92001-06-22 19:15:00 +00004743 char range[20];
4744 unsigned char payload[20];
drhab9f7f12004-05-08 10:56:11 +00004745
drh4b70f112004-05-02 21:12:19 +00004746 rc = getPage(pBt, (Pgno)pgno, &pPage);
drha2fce642004-06-05 00:01:44 +00004747 isInit = pPage->isInit;
4748 if( pPage->isInit==0 ){
4749 initPage(pPage, 0);
4750 }
drh8c42ca92001-06-22 19:15:00 +00004751 if( rc ){
4752 return rc;
4753 }
drhab9f7f12004-05-08 10:56:11 +00004754 hdr = pPage->hdrOffset;
4755 data = pPage->aData;
drhc8629a12004-05-08 20:07:40 +00004756 c = data[hdr];
drh8b18dd42004-05-12 19:18:15 +00004757 pPage->intKey = (c & (PTF_INTKEY|PTF_LEAFDATA))!=0;
drhc8629a12004-05-08 20:07:40 +00004758 pPage->zeroData = (c & PTF_ZERODATA)!=0;
drh8b18dd42004-05-12 19:18:15 +00004759 pPage->leafData = (c & PTF_LEAFDATA)!=0;
drhc8629a12004-05-08 20:07:40 +00004760 pPage->leaf = (c & PTF_LEAF)!=0;
drh8b18dd42004-05-12 19:18:15 +00004761 pPage->hasData = !(pPage->zeroData || (!pPage->leaf && pPage->leafData));
drh43605152004-05-29 21:46:49 +00004762 nCell = get2byte(&data[hdr+3]);
drhfe63d1c2004-09-08 20:13:04 +00004763 sqlite3DebugPrintf("PAGE %d: flags=0x%02x frag=%d parent=%d\n", pgno,
drh43605152004-05-29 21:46:49 +00004764 data[hdr], data[hdr+7],
drhda200cc2004-05-09 11:51:38 +00004765 (pPage->isInit && pPage->pParent) ? pPage->pParent->pgno : 0);
drhab9f7f12004-05-08 10:56:11 +00004766 assert( hdr == (pgno==1 ? 100 : 0) );
drh43605152004-05-29 21:46:49 +00004767 idx = hdr + 12 - pPage->leaf*4;
4768 for(i=0; i<nCell; i++){
drh6f11bef2004-05-13 01:12:56 +00004769 CellInfo info;
drh4b70f112004-05-02 21:12:19 +00004770 Pgno child;
drh43605152004-05-29 21:46:49 +00004771 unsigned char *pCell;
drh6f11bef2004-05-13 01:12:56 +00004772 int sz;
drh43605152004-05-29 21:46:49 +00004773 int addr;
drh6f11bef2004-05-13 01:12:56 +00004774
drh43605152004-05-29 21:46:49 +00004775 addr = get2byte(&data[idx + 2*i]);
4776 pCell = &data[addr];
4777 parseCellPtr(pPage, pCell, &info);
drh6f11bef2004-05-13 01:12:56 +00004778 sz = info.nSize;
drh43605152004-05-29 21:46:49 +00004779 sprintf(range,"%d..%d", addr, addr+sz-1);
drh4b70f112004-05-02 21:12:19 +00004780 if( pPage->leaf ){
4781 child = 0;
4782 }else{
drh43605152004-05-29 21:46:49 +00004783 child = get4byte(pCell);
drh4b70f112004-05-02 21:12:19 +00004784 }
drh6f11bef2004-05-13 01:12:56 +00004785 sz = info.nData;
4786 if( !pPage->intKey ) sz += info.nKey;
drh8c42ca92001-06-22 19:15:00 +00004787 if( sz>sizeof(payload)-1 ) sz = sizeof(payload)-1;
drh6f11bef2004-05-13 01:12:56 +00004788 memcpy(payload, &pCell[info.nHeader], sz);
drh8c42ca92001-06-22 19:15:00 +00004789 for(j=0; j<sz; j++){
4790 if( payload[j]<0x20 || payload[j]>0x7f ) payload[j] = '.';
4791 }
4792 payload[sz] = 0;
drhfe63d1c2004-09-08 20:13:04 +00004793 sqlite3DebugPrintf(
drh6f11bef2004-05-13 01:12:56 +00004794 "cell %2d: i=%-10s chld=%-4d nk=%-4lld nd=%-4d payload=%s\n",
4795 i, range, child, info.nKey, info.nData, payload
drh8c42ca92001-06-22 19:15:00 +00004796 );
drh8c42ca92001-06-22 19:15:00 +00004797 }
drh4b70f112004-05-02 21:12:19 +00004798 if( !pPage->leaf ){
drhfe63d1c2004-09-08 20:13:04 +00004799 sqlite3DebugPrintf("right_child: %d\n", get4byte(&data[hdr+8]));
drh4b70f112004-05-02 21:12:19 +00004800 }
drh8c42ca92001-06-22 19:15:00 +00004801 nFree = 0;
4802 i = 0;
drhab9f7f12004-05-08 10:56:11 +00004803 idx = get2byte(&data[hdr+1]);
drhb6f41482004-05-14 01:58:11 +00004804 while( idx>0 && idx<pPage->pBt->usableSize ){
drhab9f7f12004-05-08 10:56:11 +00004805 int sz = get2byte(&data[idx+2]);
drh4b70f112004-05-02 21:12:19 +00004806 sprintf(range,"%d..%d", idx, idx+sz-1);
4807 nFree += sz;
drhfe63d1c2004-09-08 20:13:04 +00004808 sqlite3DebugPrintf("freeblock %2d: i=%-10s size=%-4d total=%d\n",
drh4b70f112004-05-02 21:12:19 +00004809 i, range, sz, nFree);
drhab9f7f12004-05-08 10:56:11 +00004810 idx = get2byte(&data[idx]);
drh2aa679f2001-06-25 02:11:07 +00004811 i++;
drh8c42ca92001-06-22 19:15:00 +00004812 }
4813 if( idx!=0 ){
drhfe63d1c2004-09-08 20:13:04 +00004814 sqlite3DebugPrintf("ERROR: next freeblock index out of range: %d\n", idx);
drh8c42ca92001-06-22 19:15:00 +00004815 }
drha34b6762004-05-07 13:30:42 +00004816 if( recursive && !pPage->leaf ){
drh43605152004-05-29 21:46:49 +00004817 for(i=0; i<nCell; i++){
4818 unsigned char *pCell = findCell(pPage, i);
4819 sqlite3BtreePageDump(pBt, get4byte(pCell), 1);
drha34b6762004-05-07 13:30:42 +00004820 idx = get2byte(pCell);
drh6019e162001-07-02 17:51:45 +00004821 }
drh43605152004-05-29 21:46:49 +00004822 sqlite3BtreePageDump(pBt, get4byte(&data[hdr+8]), 1);
drh6019e162001-07-02 17:51:45 +00004823 }
drha2fce642004-06-05 00:01:44 +00004824 pPage->isInit = isInit;
drhab9f7f12004-05-08 10:56:11 +00004825 sqlite3pager_unref(data);
drh3644f082004-05-10 18:45:09 +00004826 fflush(stdout);
drh8c42ca92001-06-22 19:15:00 +00004827 return SQLITE_OK;
4828}
drhaaab5722002-02-19 13:39:21 +00004829#endif
drh8c42ca92001-06-22 19:15:00 +00004830
drhaaab5722002-02-19 13:39:21 +00004831#ifdef SQLITE_TEST
drh8c42ca92001-06-22 19:15:00 +00004832/*
drh2aa679f2001-06-25 02:11:07 +00004833** Fill aResult[] with information about the entry and page that the
4834** cursor is pointing to.
4835**
4836** aResult[0] = The page number
4837** aResult[1] = The entry number
4838** aResult[2] = Total number of entries on this page
drh3e27c022004-07-23 00:01:38 +00004839** aResult[3] = Cell size (local payload + header)
drh2aa679f2001-06-25 02:11:07 +00004840** aResult[4] = Number of free bytes on this page
4841** aResult[5] = Number of free blocks on the page
drh3e27c022004-07-23 00:01:38 +00004842** aResult[6] = Total payload size (local + overflow)
4843** aResult[7] = Header size in bytes
4844** aResult[8] = Local payload size
4845** aResult[9] = Parent page number
drh5eddca62001-06-30 21:53:53 +00004846**
4847** This routine is used for testing and debugging only.
drh8c42ca92001-06-22 19:15:00 +00004848*/
drh3e27c022004-07-23 00:01:38 +00004849int sqlite3BtreeCursorInfo(BtCursor *pCur, int *aResult, int upCnt){
drh2aa679f2001-06-25 02:11:07 +00004850 int cnt, idx;
4851 MemPage *pPage = pCur->pPage;
drh3e27c022004-07-23 00:01:38 +00004852 BtCursor tmpCur;
drhda200cc2004-05-09 11:51:38 +00004853
4854 pageIntegrity(pPage);
drh4b70f112004-05-02 21:12:19 +00004855 assert( pPage->isInit );
drh3e27c022004-07-23 00:01:38 +00004856 getTempCursor(pCur, &tmpCur);
4857 while( upCnt-- ){
4858 moveToParent(&tmpCur);
4859 }
4860 pPage = tmpCur.pPage;
4861 pageIntegrity(pPage);
drha34b6762004-05-07 13:30:42 +00004862 aResult[0] = sqlite3pager_pagenumber(pPage->aData);
drh91025292004-05-03 19:49:32 +00004863 assert( aResult[0]==pPage->pgno );
drh3e27c022004-07-23 00:01:38 +00004864 aResult[1] = tmpCur.idx;
drh2aa679f2001-06-25 02:11:07 +00004865 aResult[2] = pPage->nCell;
drh3e27c022004-07-23 00:01:38 +00004866 if( tmpCur.idx>=0 && tmpCur.idx<pPage->nCell ){
4867 getCellInfo(&tmpCur);
4868 aResult[3] = tmpCur.info.nSize;
4869 aResult[6] = tmpCur.info.nData;
4870 aResult[7] = tmpCur.info.nHeader;
4871 aResult[8] = tmpCur.info.nLocal;
drh2aa679f2001-06-25 02:11:07 +00004872 }else{
4873 aResult[3] = 0;
4874 aResult[6] = 0;
drh3e27c022004-07-23 00:01:38 +00004875 aResult[7] = 0;
4876 aResult[8] = 0;
drh2aa679f2001-06-25 02:11:07 +00004877 }
4878 aResult[4] = pPage->nFree;
4879 cnt = 0;
drh4b70f112004-05-02 21:12:19 +00004880 idx = get2byte(&pPage->aData[pPage->hdrOffset+1]);
drhb6f41482004-05-14 01:58:11 +00004881 while( idx>0 && idx<pPage->pBt->usableSize ){
drh2aa679f2001-06-25 02:11:07 +00004882 cnt++;
drh4b70f112004-05-02 21:12:19 +00004883 idx = get2byte(&pPage->aData[idx]);
drh2aa679f2001-06-25 02:11:07 +00004884 }
4885 aResult[5] = cnt;
drh3e27c022004-07-23 00:01:38 +00004886 if( pPage->pParent==0 || isRootPage(pPage) ){
4887 aResult[9] = 0;
4888 }else{
4889 aResult[9] = pPage->pParent->pgno;
4890 }
4891 releaseTempCursor(&tmpCur);
drh8c42ca92001-06-22 19:15:00 +00004892 return SQLITE_OK;
4893}
drhaaab5722002-02-19 13:39:21 +00004894#endif
drhdd793422001-06-28 01:54:48 +00004895
drhdd793422001-06-28 01:54:48 +00004896/*
drh5eddca62001-06-30 21:53:53 +00004897** Return the pager associated with a BTree. This routine is used for
4898** testing and debugging only.
drhdd793422001-06-28 01:54:48 +00004899*/
drh3aac2dd2004-04-26 14:10:20 +00004900Pager *sqlite3BtreePager(Btree *pBt){
drhdd793422001-06-28 01:54:48 +00004901 return pBt->pPager;
4902}
drh5eddca62001-06-30 21:53:53 +00004903
4904/*
4905** This structure is passed around through all the sanity checking routines
4906** in order to keep track of some global state information.
4907*/
drhaaab5722002-02-19 13:39:21 +00004908typedef struct IntegrityCk IntegrityCk;
4909struct IntegrityCk {
drh100569d2001-10-02 13:01:48 +00004910 Btree *pBt; /* The tree being checked out */
4911 Pager *pPager; /* The associated pager. Also accessible by pBt->pPager */
4912 int nPage; /* Number of pages in the database */
4913 int *anRef; /* Number of times each page is referenced */
drh100569d2001-10-02 13:01:48 +00004914 char *zErrMsg; /* An error message. NULL of no errors seen. */
drh5eddca62001-06-30 21:53:53 +00004915};
4916
drhb7f91642004-10-31 02:22:47 +00004917#ifndef SQLITE_OMIT_INTEGRITY_CHECK
drh5eddca62001-06-30 21:53:53 +00004918/*
4919** Append a message to the error message string.
4920*/
drh2e38c322004-09-03 18:38:44 +00004921static void checkAppendMsg(
4922 IntegrityCk *pCheck,
4923 char *zMsg1,
4924 const char *zFormat,
4925 ...
4926){
4927 va_list ap;
4928 char *zMsg2;
4929 va_start(ap, zFormat);
4930 zMsg2 = sqlite3VMPrintf(zFormat, ap);
4931 va_end(ap);
4932 if( zMsg1==0 ) zMsg1 = "";
drh5eddca62001-06-30 21:53:53 +00004933 if( pCheck->zErrMsg ){
4934 char *zOld = pCheck->zErrMsg;
4935 pCheck->zErrMsg = 0;
danielk19774adee202004-05-08 08:23:19 +00004936 sqlite3SetString(&pCheck->zErrMsg, zOld, "\n", zMsg1, zMsg2, (char*)0);
drh5eddca62001-06-30 21:53:53 +00004937 sqliteFree(zOld);
4938 }else{
danielk19774adee202004-05-08 08:23:19 +00004939 sqlite3SetString(&pCheck->zErrMsg, zMsg1, zMsg2, (char*)0);
drh5eddca62001-06-30 21:53:53 +00004940 }
drh2e38c322004-09-03 18:38:44 +00004941 sqliteFree(zMsg2);
drh5eddca62001-06-30 21:53:53 +00004942}
drhb7f91642004-10-31 02:22:47 +00004943#endif /* SQLITE_OMIT_INTEGRITY_CHECK */
drh5eddca62001-06-30 21:53:53 +00004944
drhb7f91642004-10-31 02:22:47 +00004945#ifndef SQLITE_OMIT_INTEGRITY_CHECK
drh5eddca62001-06-30 21:53:53 +00004946/*
4947** Add 1 to the reference count for page iPage. If this is the second
4948** reference to the page, add an error message to pCheck->zErrMsg.
4949** Return 1 if there are 2 ore more references to the page and 0 if
4950** if this is the first reference to the page.
4951**
4952** Also check that the page number is in bounds.
4953*/
drhaaab5722002-02-19 13:39:21 +00004954static int checkRef(IntegrityCk *pCheck, int iPage, char *zContext){
drh5eddca62001-06-30 21:53:53 +00004955 if( iPage==0 ) return 1;
drh0de8c112002-07-06 16:32:14 +00004956 if( iPage>pCheck->nPage || iPage<0 ){
drh2e38c322004-09-03 18:38:44 +00004957 checkAppendMsg(pCheck, zContext, "invalid page number %d", iPage);
drh5eddca62001-06-30 21:53:53 +00004958 return 1;
4959 }
4960 if( pCheck->anRef[iPage]==1 ){
drh2e38c322004-09-03 18:38:44 +00004961 checkAppendMsg(pCheck, zContext, "2nd reference to page %d", iPage);
drh5eddca62001-06-30 21:53:53 +00004962 return 1;
4963 }
4964 return (pCheck->anRef[iPage]++)>1;
4965}
4966
danielk1977afcdd022004-10-31 16:25:42 +00004967#ifndef SQLITE_OMIT_AUTOVACUUM
4968/*
4969** Check that the entry in the pointer-map for page iChild maps to
4970** page iParent, pointer type ptrType. If not, append an error message
4971** to pCheck.
4972*/
4973static void checkPtrmap(
4974 IntegrityCk *pCheck, /* Integrity check context */
4975 Pgno iChild, /* Child page number */
4976 u8 eType, /* Expected pointer map type */
4977 Pgno iParent, /* Expected pointer map parent page number */
4978 char *zContext /* Context description (used for error msg) */
4979){
4980 int rc;
4981 u8 ePtrmapType;
4982 Pgno iPtrmapParent;
4983
4984 rc = ptrmapGet(pCheck->pBt, iChild, &ePtrmapType, &iPtrmapParent);
4985 if( rc!=SQLITE_OK ){
4986 checkAppendMsg(pCheck, zContext, "Failed to read ptrmap key=%d", iChild);
4987 return;
4988 }
4989
4990 if( ePtrmapType!=eType || iPtrmapParent!=iParent ){
4991 checkAppendMsg(pCheck, zContext,
4992 "Bad ptr map entry key=%d expected=(%d,%d) got=(%d,%d)",
4993 iChild, eType, iParent, ePtrmapType, iPtrmapParent);
4994 }
4995}
4996#endif
4997
drh5eddca62001-06-30 21:53:53 +00004998/*
4999** Check the integrity of the freelist or of an overflow page list.
5000** Verify that the number of pages on the list is N.
5001*/
drh30e58752002-03-02 20:41:57 +00005002static void checkList(
5003 IntegrityCk *pCheck, /* Integrity checking context */
5004 int isFreeList, /* True for a freelist. False for overflow page list */
5005 int iPage, /* Page number for first page in the list */
5006 int N, /* Expected number of pages in the list */
5007 char *zContext /* Context for error messages */
5008){
5009 int i;
drh3a4c1412004-05-09 20:40:11 +00005010 int expected = N;
5011 int iFirst = iPage;
drh30e58752002-03-02 20:41:57 +00005012 while( N-- > 0 ){
drh4b70f112004-05-02 21:12:19 +00005013 unsigned char *pOvfl;
drh5eddca62001-06-30 21:53:53 +00005014 if( iPage<1 ){
drh2e38c322004-09-03 18:38:44 +00005015 checkAppendMsg(pCheck, zContext,
5016 "%d of %d pages missing from overflow list starting at %d",
drh3a4c1412004-05-09 20:40:11 +00005017 N+1, expected, iFirst);
drh5eddca62001-06-30 21:53:53 +00005018 break;
5019 }
5020 if( checkRef(pCheck, iPage, zContext) ) break;
drha34b6762004-05-07 13:30:42 +00005021 if( sqlite3pager_get(pCheck->pPager, (Pgno)iPage, (void**)&pOvfl) ){
drh2e38c322004-09-03 18:38:44 +00005022 checkAppendMsg(pCheck, zContext, "failed to get page %d", iPage);
drh5eddca62001-06-30 21:53:53 +00005023 break;
5024 }
drh30e58752002-03-02 20:41:57 +00005025 if( isFreeList ){
drh4b70f112004-05-02 21:12:19 +00005026 int n = get4byte(&pOvfl[4]);
danielk1977687566d2004-11-02 12:56:41 +00005027#ifndef SQLITE_OMIT_AUTOVACUUM
5028 if( pCheck->pBt->autoVacuum ){
5029 checkPtrmap(pCheck, iPage, PTRMAP_FREEPAGE, 0, zContext);
5030 }
5031#endif
drh855eb1c2004-08-31 13:45:11 +00005032 if( n>pCheck->pBt->usableSize/4-8 ){
drh2e38c322004-09-03 18:38:44 +00005033 checkAppendMsg(pCheck, zContext,
5034 "freelist leaf count too big on page %d", iPage);
drhee696e22004-08-30 16:52:17 +00005035 N--;
5036 }else{
5037 for(i=0; i<n; i++){
danielk1977687566d2004-11-02 12:56:41 +00005038 Pgno iFreePage = get4byte(&pOvfl[8+i*4]);
5039#ifndef SQLITE_OMIT_AUTOVACUUM
5040 if( pCheck->pBt->autoVacuum ){
5041 checkPtrmap(pCheck, iFreePage, PTRMAP_FREEPAGE, 0, zContext);
5042 }
5043#endif
5044 checkRef(pCheck, iFreePage, zContext);
drhee696e22004-08-30 16:52:17 +00005045 }
5046 N -= n;
drh30e58752002-03-02 20:41:57 +00005047 }
drh30e58752002-03-02 20:41:57 +00005048 }
danielk1977afcdd022004-10-31 16:25:42 +00005049#ifndef SQLITE_OMIT_AUTOVACUUM
danielk1977687566d2004-11-02 12:56:41 +00005050 else{
5051 /* If this database supports auto-vacuum and iPage is not the last
5052 ** page in this overflow list, check that the pointer-map entry for
5053 ** the following page matches iPage.
5054 */
5055 if( pCheck->pBt->autoVacuum && N>0 ){
5056 i = get4byte(pOvfl);
5057 checkPtrmap(pCheck, i, PTRMAP_OVERFLOW2, iPage, zContext);
5058 }
danielk1977afcdd022004-10-31 16:25:42 +00005059 }
5060#endif
drh4b70f112004-05-02 21:12:19 +00005061 iPage = get4byte(pOvfl);
drha34b6762004-05-07 13:30:42 +00005062 sqlite3pager_unref(pOvfl);
drh5eddca62001-06-30 21:53:53 +00005063 }
5064}
drhb7f91642004-10-31 02:22:47 +00005065#endif /* SQLITE_OMIT_INTEGRITY_CHECK */
drh5eddca62001-06-30 21:53:53 +00005066
drhb7f91642004-10-31 02:22:47 +00005067#ifndef SQLITE_OMIT_INTEGRITY_CHECK
drh5eddca62001-06-30 21:53:53 +00005068/*
5069** Do various sanity checks on a single page of a tree. Return
5070** the tree depth. Root pages return 0. Parents of root pages
5071** return 1, and so forth.
5072**
5073** These checks are done:
5074**
5075** 1. Make sure that cells and freeblocks do not overlap
5076** but combine to completely cover the page.
drhda200cc2004-05-09 11:51:38 +00005077** NO 2. Make sure cell keys are in order.
5078** NO 3. Make sure no key is less than or equal to zLowerBound.
5079** NO 4. Make sure no key is greater than or equal to zUpperBound.
drh5eddca62001-06-30 21:53:53 +00005080** 5. Check the integrity of overflow pages.
5081** 6. Recursively call checkTreePage on all children.
5082** 7. Verify that the depth of all children is the same.
drh6019e162001-07-02 17:51:45 +00005083** 8. Make sure this page is at least 33% full or else it is
drh5eddca62001-06-30 21:53:53 +00005084** the root of the tree.
5085*/
5086static int checkTreePage(
drhaaab5722002-02-19 13:39:21 +00005087 IntegrityCk *pCheck, /* Context for the sanity check */
drh5eddca62001-06-30 21:53:53 +00005088 int iPage, /* Page number of the page to check */
5089 MemPage *pParent, /* Parent page */
5090 char *zParentContext, /* Parent context */
5091 char *zLowerBound, /* All keys should be greater than this, if not NULL */
drh1bffb9c2002-02-03 17:37:36 +00005092 int nLower, /* Number of characters in zLowerBound */
5093 char *zUpperBound, /* All keys should be less than this, if not NULL */
5094 int nUpper /* Number of characters in zUpperBound */
drh5eddca62001-06-30 21:53:53 +00005095){
5096 MemPage *pPage;
drhda200cc2004-05-09 11:51:38 +00005097 int i, rc, depth, d2, pgno, cnt;
drh43605152004-05-29 21:46:49 +00005098 int hdr, cellStart;
5099 int nCell;
drhda200cc2004-05-09 11:51:38 +00005100 u8 *data;
drh5eddca62001-06-30 21:53:53 +00005101 BtCursor cur;
drh0d316a42002-08-11 20:10:47 +00005102 Btree *pBt;
drhb6f41482004-05-14 01:58:11 +00005103 int maxLocal, usableSize;
drh5eddca62001-06-30 21:53:53 +00005104 char zContext[100];
drh2e38c322004-09-03 18:38:44 +00005105 char *hit;
drh5eddca62001-06-30 21:53:53 +00005106
danielk1977ef73ee92004-11-06 12:26:07 +00005107 sprintf(zContext, "Page %d: ", iPage);
5108
drh5eddca62001-06-30 21:53:53 +00005109 /* Check that the page exists
5110 */
drh0d316a42002-08-11 20:10:47 +00005111 cur.pBt = pBt = pCheck->pBt;
drhb6f41482004-05-14 01:58:11 +00005112 usableSize = pBt->usableSize;
drh5eddca62001-06-30 21:53:53 +00005113 if( iPage==0 ) return 0;
5114 if( checkRef(pCheck, iPage, zParentContext) ) return 0;
drh4b70f112004-05-02 21:12:19 +00005115 if( (rc = getPage(pBt, (Pgno)iPage, &pPage))!=0 ){
drh2e38c322004-09-03 18:38:44 +00005116 checkAppendMsg(pCheck, zContext,
5117 "unable to get the page. error code=%d", rc);
drh5eddca62001-06-30 21:53:53 +00005118 return 0;
5119 }
drh6f11bef2004-05-13 01:12:56 +00005120 maxLocal = pPage->leafData ? pBt->maxLeaf : pBt->maxLocal;
drh4b70f112004-05-02 21:12:19 +00005121 if( (rc = initPage(pPage, pParent))!=0 ){
drh2e38c322004-09-03 18:38:44 +00005122 checkAppendMsg(pCheck, zContext, "initPage() returns error code %d", rc);
drh91025292004-05-03 19:49:32 +00005123 releasePage(pPage);
drh5eddca62001-06-30 21:53:53 +00005124 return 0;
5125 }
5126
5127 /* Check out all the cells.
5128 */
5129 depth = 0;
drh5eddca62001-06-30 21:53:53 +00005130 cur.pPage = pPage;
drh5eddca62001-06-30 21:53:53 +00005131 for(i=0; i<pPage->nCell; i++){
drh6f11bef2004-05-13 01:12:56 +00005132 u8 *pCell;
5133 int sz;
5134 CellInfo info;
drh5eddca62001-06-30 21:53:53 +00005135
5136 /* Check payload overflow pages
5137 */
drh3a4c1412004-05-09 20:40:11 +00005138 sprintf(zContext, "On tree page %d cell %d: ", iPage, i);
drh43605152004-05-29 21:46:49 +00005139 pCell = findCell(pPage,i);
5140 parseCellPtr(pPage, pCell, &info);
drh6f11bef2004-05-13 01:12:56 +00005141 sz = info.nData;
5142 if( !pPage->intKey ) sz += info.nKey;
5143 if( sz>info.nLocal ){
drhb6f41482004-05-14 01:58:11 +00005144 int nPage = (sz - info.nLocal + usableSize - 5)/(usableSize - 4);
danielk1977afcdd022004-10-31 16:25:42 +00005145 Pgno pgnoOvfl = get4byte(&pCell[info.iOverflow]);
5146#ifndef SQLITE_OMIT_AUTOVACUUM
5147 if( pBt->autoVacuum ){
danielk1977687566d2004-11-02 12:56:41 +00005148 checkPtrmap(pCheck, pgnoOvfl, PTRMAP_OVERFLOW1, iPage, zContext);
danielk1977afcdd022004-10-31 16:25:42 +00005149 }
5150#endif
5151 checkList(pCheck, 0, pgnoOvfl, nPage, zContext);
drh5eddca62001-06-30 21:53:53 +00005152 }
5153
5154 /* Check sanity of left child page.
5155 */
drhda200cc2004-05-09 11:51:38 +00005156 if( !pPage->leaf ){
drh43605152004-05-29 21:46:49 +00005157 pgno = get4byte(pCell);
danielk1977afcdd022004-10-31 16:25:42 +00005158#ifndef SQLITE_OMIT_AUTOVACUUM
5159 if( pBt->autoVacuum ){
5160 checkPtrmap(pCheck, pgno, PTRMAP_BTREE, iPage, zContext);
5161 }
5162#endif
drhda200cc2004-05-09 11:51:38 +00005163 d2 = checkTreePage(pCheck,pgno,pPage,zContext,0,0,0,0);
5164 if( i>0 && d2!=depth ){
5165 checkAppendMsg(pCheck, zContext, "Child page depth differs");
5166 }
5167 depth = d2;
drh5eddca62001-06-30 21:53:53 +00005168 }
drh5eddca62001-06-30 21:53:53 +00005169 }
drhda200cc2004-05-09 11:51:38 +00005170 if( !pPage->leaf ){
drh43605152004-05-29 21:46:49 +00005171 pgno = get4byte(&pPage->aData[pPage->hdrOffset+8]);
drhda200cc2004-05-09 11:51:38 +00005172 sprintf(zContext, "On page %d at right child: ", iPage);
danielk1977afcdd022004-10-31 16:25:42 +00005173#ifndef SQLITE_OMIT_AUTOVACUUM
5174 if( pBt->autoVacuum ){
danielk1977687566d2004-11-02 12:56:41 +00005175 checkPtrmap(pCheck, pgno, PTRMAP_BTREE, iPage, 0);
danielk1977afcdd022004-10-31 16:25:42 +00005176 }
5177#endif
drhda200cc2004-05-09 11:51:38 +00005178 checkTreePage(pCheck, pgno, pPage, zContext,0,0,0,0);
5179 }
drh5eddca62001-06-30 21:53:53 +00005180
5181 /* Check for complete coverage of the page
5182 */
drhda200cc2004-05-09 11:51:38 +00005183 data = pPage->aData;
5184 hdr = pPage->hdrOffset;
drh2e38c322004-09-03 18:38:44 +00005185 hit = sqliteMalloc( usableSize );
5186 if( hit ){
5187 memset(hit, 1, get2byte(&data[hdr+5]));
5188 nCell = get2byte(&data[hdr+3]);
5189 cellStart = hdr + 12 - 4*pPage->leaf;
5190 for(i=0; i<nCell; i++){
5191 int pc = get2byte(&data[cellStart+i*2]);
5192 int size = cellSizePtr(pPage, &data[pc]);
5193 int j;
5194 for(j=pc+size-1; j>=pc; j--) hit[j]++;
5195 }
5196 for(cnt=0, i=get2byte(&data[hdr+1]); i>0 && i<usableSize && cnt<10000;
5197 cnt++){
5198 int size = get2byte(&data[i+2]);
5199 int j;
5200 for(j=i+size-1; j>=i; j--) hit[j]++;
5201 i = get2byte(&data[i]);
5202 }
5203 for(i=cnt=0; i<usableSize; i++){
5204 if( hit[i]==0 ){
5205 cnt++;
5206 }else if( hit[i]>1 ){
5207 checkAppendMsg(pCheck, 0,
5208 "Multiple uses for byte %d of page %d", i, iPage);
5209 break;
5210 }
5211 }
5212 if( cnt!=data[hdr+7] ){
5213 checkAppendMsg(pCheck, 0,
5214 "Fragmented space is %d byte reported as %d on page %d",
5215 cnt, data[hdr+7], iPage);
drh5eddca62001-06-30 21:53:53 +00005216 }
5217 }
drh2e38c322004-09-03 18:38:44 +00005218 sqliteFree(hit);
drh6019e162001-07-02 17:51:45 +00005219
drh4b70f112004-05-02 21:12:19 +00005220 releasePage(pPage);
drhda200cc2004-05-09 11:51:38 +00005221 return depth+1;
drh5eddca62001-06-30 21:53:53 +00005222}
drhb7f91642004-10-31 02:22:47 +00005223#endif /* SQLITE_OMIT_INTEGRITY_CHECK */
drh5eddca62001-06-30 21:53:53 +00005224
drhb7f91642004-10-31 02:22:47 +00005225#ifndef SQLITE_OMIT_INTEGRITY_CHECK
drh5eddca62001-06-30 21:53:53 +00005226/*
5227** This routine does a complete check of the given BTree file. aRoot[] is
5228** an array of pages numbers were each page number is the root page of
5229** a table. nRoot is the number of entries in aRoot.
5230**
5231** If everything checks out, this routine returns NULL. If something is
5232** amiss, an error message is written into memory obtained from malloc()
5233** and a pointer to that error message is returned. The calling function
5234** is responsible for freeing the error message when it is done.
5235*/
drh3aac2dd2004-04-26 14:10:20 +00005236char *sqlite3BtreeIntegrityCheck(Btree *pBt, int *aRoot, int nRoot){
drh5eddca62001-06-30 21:53:53 +00005237 int i;
5238 int nRef;
drhaaab5722002-02-19 13:39:21 +00005239 IntegrityCk sCheck;
drh5eddca62001-06-30 21:53:53 +00005240
drha34b6762004-05-07 13:30:42 +00005241 nRef = *sqlite3pager_stats(pBt->pPager);
drhefc251d2001-07-01 22:12:01 +00005242 if( lockBtree(pBt)!=SQLITE_OK ){
5243 return sqliteStrDup("Unable to acquire a read lock on the database");
5244 }
drh5eddca62001-06-30 21:53:53 +00005245 sCheck.pBt = pBt;
5246 sCheck.pPager = pBt->pPager;
drha34b6762004-05-07 13:30:42 +00005247 sCheck.nPage = sqlite3pager_pagecount(sCheck.pPager);
drh0de8c112002-07-06 16:32:14 +00005248 if( sCheck.nPage==0 ){
5249 unlockBtreeIfUnused(pBt);
5250 return 0;
5251 }
drh8c1238a2003-01-02 14:43:55 +00005252 sCheck.anRef = sqliteMallocRaw( (sCheck.nPage+1)*sizeof(sCheck.anRef[0]) );
drhda200cc2004-05-09 11:51:38 +00005253 for(i=0; i<=sCheck.nPage; i++){ sCheck.anRef[i] = 0; }
drh1f595712004-06-15 01:40:29 +00005254 i = PENDING_BYTE/pBt->pageSize + 1;
5255 if( i<=sCheck.nPage ){
5256 sCheck.anRef[i] = 1;
5257 }
drh5eddca62001-06-30 21:53:53 +00005258 sCheck.zErrMsg = 0;
5259
5260 /* Check the integrity of the freelist
5261 */
drha34b6762004-05-07 13:30:42 +00005262 checkList(&sCheck, 1, get4byte(&pBt->pPage1->aData[32]),
5263 get4byte(&pBt->pPage1->aData[36]), "Main freelist: ");
drh5eddca62001-06-30 21:53:53 +00005264
5265 /* Check all the tables.
5266 */
5267 for(i=0; i<nRoot; i++){
drh4ff6dfa2002-03-03 23:06:00 +00005268 if( aRoot[i]==0 ) continue;
danielk1977687566d2004-11-02 12:56:41 +00005269#ifndef SQLITE_OMIT_AUTOVACUUM
5270/* Note: This is temporary code for use during development of auto-vacuum. */
5271 if( pBt->autoVacuum && aRoot[i]>1 ){
5272 checkPtrmap(&sCheck, aRoot[i], PTRMAP_ROOTPAGE, 0, 0);
5273 }
5274#endif
drh1bffb9c2002-02-03 17:37:36 +00005275 checkTreePage(&sCheck, aRoot[i], 0, "List of tree roots: ", 0,0,0,0);
drh5eddca62001-06-30 21:53:53 +00005276 }
5277
5278 /* Make sure every page in the file is referenced
5279 */
5280 for(i=1; i<=sCheck.nPage; i++){
danielk1977afcdd022004-10-31 16:25:42 +00005281#ifdef SQLITE_OMIT_AUTOVACUUM
drh5eddca62001-06-30 21:53:53 +00005282 if( sCheck.anRef[i]==0 ){
drh2e38c322004-09-03 18:38:44 +00005283 checkAppendMsg(&sCheck, 0, "Page %d is never used", i);
drh5eddca62001-06-30 21:53:53 +00005284 }
danielk1977afcdd022004-10-31 16:25:42 +00005285#else
5286 /* If the database supports auto-vacuum, make sure no tables contain
5287 ** references to pointer-map pages.
5288 */
5289 if( sCheck.anRef[i]==0 &&
5290 (PTRMAP_PAGENO(pBt->pageSize, i)!=i || !pBt->autoVacuum) ){
5291 checkAppendMsg(&sCheck, 0, "Page %d is never used", i);
5292 }
5293 if( sCheck.anRef[i]!=0 &&
5294 (PTRMAP_PAGENO(pBt->pageSize, i)==i && pBt->autoVacuum) ){
5295 checkAppendMsg(&sCheck, 0, "Pointer map page %d is referenced", i);
5296 }
5297#endif
drh5eddca62001-06-30 21:53:53 +00005298 }
5299
5300 /* Make sure this analysis did not leave any unref() pages
5301 */
drh5e00f6c2001-09-13 13:46:56 +00005302 unlockBtreeIfUnused(pBt);
drha34b6762004-05-07 13:30:42 +00005303 if( nRef != *sqlite3pager_stats(pBt->pPager) ){
drh2e38c322004-09-03 18:38:44 +00005304 checkAppendMsg(&sCheck, 0,
drh5eddca62001-06-30 21:53:53 +00005305 "Outstanding page count goes from %d to %d during this analysis",
drha34b6762004-05-07 13:30:42 +00005306 nRef, *sqlite3pager_stats(pBt->pPager)
drh5eddca62001-06-30 21:53:53 +00005307 );
drh5eddca62001-06-30 21:53:53 +00005308 }
5309
5310 /* Clean up and report errors.
5311 */
5312 sqliteFree(sCheck.anRef);
5313 return sCheck.zErrMsg;
5314}
drhb7f91642004-10-31 02:22:47 +00005315#endif /* SQLITE_OMIT_INTEGRITY_CHECK */
paulb95a8862003-04-01 21:16:41 +00005316
drh73509ee2003-04-06 20:44:45 +00005317/*
5318** Return the full pathname of the underlying database file.
5319*/
drh3aac2dd2004-04-26 14:10:20 +00005320const char *sqlite3BtreeGetFilename(Btree *pBt){
drh73509ee2003-04-06 20:44:45 +00005321 assert( pBt->pPager!=0 );
drha34b6762004-05-07 13:30:42 +00005322 return sqlite3pager_filename(pBt->pPager);
drh73509ee2003-04-06 20:44:45 +00005323}
5324
5325/*
danielk19775865e3d2004-06-14 06:03:57 +00005326** Return the pathname of the directory that contains the database file.
5327*/
5328const char *sqlite3BtreeGetDirname(Btree *pBt){
5329 assert( pBt->pPager!=0 );
5330 return sqlite3pager_dirname(pBt->pPager);
5331}
5332
5333/*
5334** Return the pathname of the journal file for this database. The return
5335** value of this routine is the same regardless of whether the journal file
5336** has been created or not.
5337*/
5338const char *sqlite3BtreeGetJournalname(Btree *pBt){
5339 assert( pBt->pPager!=0 );
5340 return sqlite3pager_journalname(pBt->pPager);
5341}
5342
drhb7f91642004-10-31 02:22:47 +00005343#ifndef SQLITE_OMIT_VACUUM
danielk19775865e3d2004-06-14 06:03:57 +00005344/*
drhf7c57532003-04-25 13:22:51 +00005345** Copy the complete content of pBtFrom into pBtTo. A transaction
5346** must be active for both files.
5347**
5348** The size of file pBtFrom may be reduced by this operation.
drh43605152004-05-29 21:46:49 +00005349** If anything goes wrong, the transaction on pBtFrom is rolled back.
drh73509ee2003-04-06 20:44:45 +00005350*/
drh3aac2dd2004-04-26 14:10:20 +00005351int sqlite3BtreeCopyFile(Btree *pBtTo, Btree *pBtFrom){
drhf7c57532003-04-25 13:22:51 +00005352 int rc = SQLITE_OK;
drh2e6d11b2003-04-25 15:37:57 +00005353 Pgno i, nPage, nToPage;
drhf7c57532003-04-25 13:22:51 +00005354
danielk1977ee5741e2004-05-31 10:01:34 +00005355 if( pBtTo->inTrans!=TRANS_WRITE || pBtFrom->inTrans!=TRANS_WRITE ){
5356 return SQLITE_ERROR;
5357 }
drhf7c57532003-04-25 13:22:51 +00005358 if( pBtTo->pCursor ) return SQLITE_BUSY;
drha34b6762004-05-07 13:30:42 +00005359 nToPage = sqlite3pager_pagecount(pBtTo->pPager);
5360 nPage = sqlite3pager_pagecount(pBtFrom->pPager);
danielk1977369f27e2004-06-15 11:40:04 +00005361 for(i=1; rc==SQLITE_OK && i<=nPage; i++){
drhf7c57532003-04-25 13:22:51 +00005362 void *pPage;
drha34b6762004-05-07 13:30:42 +00005363 rc = sqlite3pager_get(pBtFrom->pPager, i, &pPage);
drhf7c57532003-04-25 13:22:51 +00005364 if( rc ) break;
drha34b6762004-05-07 13:30:42 +00005365 rc = sqlite3pager_overwrite(pBtTo->pPager, i, pPage);
drh2e6d11b2003-04-25 15:37:57 +00005366 if( rc ) break;
drha34b6762004-05-07 13:30:42 +00005367 sqlite3pager_unref(pPage);
drhf7c57532003-04-25 13:22:51 +00005368 }
drh2e6d11b2003-04-25 15:37:57 +00005369 for(i=nPage+1; rc==SQLITE_OK && i<=nToPage; i++){
5370 void *pPage;
drha34b6762004-05-07 13:30:42 +00005371 rc = sqlite3pager_get(pBtTo->pPager, i, &pPage);
drh2e6d11b2003-04-25 15:37:57 +00005372 if( rc ) break;
drha34b6762004-05-07 13:30:42 +00005373 rc = sqlite3pager_write(pPage);
5374 sqlite3pager_unref(pPage);
5375 sqlite3pager_dont_write(pBtTo->pPager, i);
drh2e6d11b2003-04-25 15:37:57 +00005376 }
5377 if( !rc && nPage<nToPage ){
drha34b6762004-05-07 13:30:42 +00005378 rc = sqlite3pager_truncate(pBtTo->pPager, nPage);
drh2e6d11b2003-04-25 15:37:57 +00005379 }
drhf7c57532003-04-25 13:22:51 +00005380 if( rc ){
drh3aac2dd2004-04-26 14:10:20 +00005381 sqlite3BtreeRollback(pBtTo);
drhf7c57532003-04-25 13:22:51 +00005382 }
5383 return rc;
drh73509ee2003-04-06 20:44:45 +00005384}
drhb7f91642004-10-31 02:22:47 +00005385#endif /* SQLITE_OMIT_VACUUM */
danielk19771d850a72004-05-31 08:26:49 +00005386
5387/*
5388** Return non-zero if a transaction is active.
5389*/
5390int sqlite3BtreeIsInTrans(Btree *pBt){
danielk1977ee5741e2004-05-31 10:01:34 +00005391 return (pBt && (pBt->inTrans==TRANS_WRITE));
danielk19771d850a72004-05-31 08:26:49 +00005392}
5393
5394/*
5395** Return non-zero if a statement transaction is active.
5396*/
5397int sqlite3BtreeIsInStmt(Btree *pBt){
5398 return (pBt && pBt->inStmt);
5399}
danielk197713adf8a2004-06-03 16:08:41 +00005400
5401/*
5402** This call is a no-op if no write-transaction is currently active on pBt.
5403**
5404** Otherwise, sync the database file for the btree pBt. zMaster points to
5405** the name of a master journal file that should be written into the
5406** individual journal file, or is NULL, indicating no master journal file
5407** (single database transaction).
5408**
5409** When this is called, the master journal should already have been
5410** created, populated with this journal pointer and synced to disk.
5411**
5412** Once this is routine has returned, the only thing required to commit
5413** the write-transaction for this database file is to delete the journal.
5414*/
5415int sqlite3BtreeSync(Btree *pBt, const char *zMaster){
5416 if( pBt->inTrans==TRANS_WRITE ){
danielk1977687566d2004-11-02 12:56:41 +00005417#ifndef SQLITE_OMIT_AUTOVACUUM
danielk1977d761c0c2004-11-05 16:37:02 +00005418 Pgno nTrunc = 0;
danielk1977687566d2004-11-02 12:56:41 +00005419 if( pBt->autoVacuum ){
danielk1977d761c0c2004-11-05 16:37:02 +00005420 int rc = autoVacuumCommit(pBt, &nTrunc);
danielk1977687566d2004-11-02 12:56:41 +00005421 if( rc!=SQLITE_OK ) return rc;
5422 }
danielk1977d761c0c2004-11-05 16:37:02 +00005423 return sqlite3pager_sync(pBt->pPager, zMaster, nTrunc);
danielk1977687566d2004-11-02 12:56:41 +00005424#endif
danielk1977d761c0c2004-11-05 16:37:02 +00005425 return sqlite3pager_sync(pBt->pPager, zMaster, 0);
danielk197713adf8a2004-06-03 16:08:41 +00005426 }
5427 return SQLITE_OK;
5428}