dbfp_pub/docs/devnotes

146 lines
3.9 KiB
Plaintext

[[ TODO ]]
[ MD5 Index ]
-modify fingerprint compare feature to use the index
-test android pull (regression testing)
-try VM android pull?
-use adb bridging technique
-test modified databases and the fingerprints created
-index integrity
-get number of fingerprints processed, compared to # in folder
SELECT SUM (fp_count) FROM md5_all
-add "-idxf" "--index_force" to force a re-index
-first give info about current index
-next, create a new index
-give info about new index
"152 fingerprints in the index"
"Creating a new index. Moved previous to backup"
"Creating... FINISHED."
"168 fingerprints in the new index"
[ Android Data ]
-Processing of android data
-removed verbose messsage for each fingerprint
-fix error message to look good
[ Module Cleanup ]
-remove print statements (from modules)
-add logging statements
-add exception throwing
-add unit testing
-test md5 sum create of tables
-test md5 sum create of entire db (tables concatenated)
[ Incorporate with another Product ]
-add module to other python project
-add unit test to other python project
[[ Code Snippets ]]
self.db_conn.execute('''
CREATE TABLE md5_index (
md5_all TEXT PRIMARY KEY,
md5_list TEXT,
file_name TEXT);
''')
[[ Testing ]]
[ fingerprint modified by me for testing ]
com.google.android.gms__fitness.db.johnegq_gmail.com__dbfp.json
"Account143": "1921c8925235e313a92f2591f8d3c8b4",
ADDED
"addedField1" : {
"datatype": "INTEGER",
"default": "0",
"notnull": true
},
"addedField2" : {
"datatype": "INTEGER",
"default": "0",
"notnull": true
},
"addedField3" : {
"datatype": "INTEGER",
"default": "0",
"notnull": true
}
com.google.android.gms__keys.db__dbfp.json
REMOVED
"AccountEventIndex": "CREATE TABLE AccountEventIndex ( account_name TEXT NOT NULL, event_index INTEGER NOT NULL, UNIQUE(account_name))",
"AccountEventIndex": "c39a79a61eb08300945a8f88493c9c79",
"AccountEventIndex": {
"account_name": {
"datatype": "TEXT",
"notnull": true,
"unique": true
},
"event_index": {
"datatype": "INTEGER",
"notnull": true
}
},
com.google.android.youtube__youtube_upload_service__dbfp.json
"OfflineHttpRequestProto": "162c915fb22c0efd19d6988215982a1a",
"transfers": "81cef0b7868db82186d659eb188d92e8"
REMOVED
"insertionOrder": {
"autoincrement": true,
"datatype": "INTEGER",
"primarykey": true
},
"network_uri": {
"datatype": "TEXT"
},
"output_extras": {
"datatype": "BLOB"
},
"priority": {
"datatype": "INTEGER",
"default": "0"
},
"status": {
"datatype": "INTEGER"
},
"status_reason": {
"datatype": "INTEGER"
}
ADDED
"addedField1" : {
"datatype": "INTEGER",
"default": "0",
"notnull": true
},
"addedField2" : {
"datatype": "INTEGER",
"default": "0",
"notnull": true
},
"addedField3" : {
"datatype": "INTEGER",
"default": "0",
"notnull": true
}
tv.periscope.android__com.localytics.android.c685a165210ff465709ae8d359bef6c90f17a12f344206db16d6f2f7f129e34f.profile.sqlite__dbfp.json
[[ Errors ]]